BotCost.dev: Free Analyzer to See How Much AI Bots Cost Your Site
BotCost.dev is a free analyzer that lets you paste your Nginx, Apache, Cloudflare, or Vercel log file and immediately see which AI bots are crawling your site and exactly how much bandwidth they're burning. No account, no upload — everything stays in your browser.
How it works
- Drop your log file — supports access.log, access.csv, or vercel-logs.json. All processing is client-side.
- Analyze — the tool matches each request against 18 known bot fingerprints including GPTBot, ClaudeBot, Bytespider, CCBot, and Perplexity. It calculates the estimated bandwidth cost in dollars.
- Block — outputs a ready-to-paste WAF rule for Cloudflare, Nginx, Next.js, or a robots.txt snippet. Copy and deploy instantly.
Key numbers from the source
- 38% of all web traffic is now non-human, mostly AI scrapers.
- For a typical site with 50k visitors/month, AI bots cost an estimated $180/month in bandwidth.
- BotCost verification latency is <10ms, running at Cloudflare's edge with zero impact on real users.
Why this matters
If you run a site with public content, bots like GPTBot and ClaudeBot can rack up significant bandwidth costs. This tool gives you a concrete dollar figure so you can decide whether to block them. The one-line WAF rule approach means you can stop the bleeding in minutes without complex configuration.
📖 Read the full source: HN AI Agents
👀 See Also
Benchmark: Gemma4 12B vs Qwen3 8B quantized on 24GB Mac Mini
A developer tested Gemma4 12B against Qwen3:8b-q4_K_M on a 24GB Mac Mini using two prompts. Qwen3 processed prompts 4-5x faster, while Gemma4 generated output slightly faster.
Codev: AI agent workflow for 106 PRs in 14 days
Codev is an open-source system that coordinates multiple AI agents through a strict Spec→Plan→Implement→Review→PR workflow, catching 20 bugs before shipping and producing code rated 1.2 points better on a 10-point scale.
Claude Code Hook Monitors WIP Accumulation in AI Coding Workflows
A developer built a UserPromptSubmit hook for Claude Code that surfaces work-in-progress accumulation across four queues: uncommitted changes over 200 lines, three or more unpushed commits, pushed commits without changeset files, and release PRs open longer than 24 hours.
PreToolUse Hook Fixes Claude Code Image Crash Problem
A developer created a PreToolUse hook that intercepts Claude Code's Read calls on images, converts them safely, and proxies them through a Haiku subprocess to prevent API Error 400 crashes from problematic images.