LLM Council Analysis Reveals Practical Claude Code Token Optimization Strategies
Problem and Experiment Setup
A developer experiencing daily Claude Code usage limits conducted an experiment using LLM Council (https://github.com/karpathy/llm-council). The setup involved 5 different personas that were forced to critique, challenge, and refine solutions, followed by a peer review round.
Key Findings
The analysis revealed that the biggest token drain wasn't complexity, but using "thinking mode" by default. This alone was burning tokens almost like Opus.
Practical Optimization Habits
- Turn OFF extended thinking by default
- /clear after every git commit (non-negotiable)
- Stop writing "yes / continue" prompts
- /compact every ~40 messages
- Keep CLAUDE.md lean or you pay tax every session
Mental Shift and Results
The core insight: Stop treating intelligence as default. Treat it like a resource you deploy intentionally. This shift enables:
- 30-50% token savings instantly
- Ability to actually use Opus without fear
- Predictable daily workflow instead of random limit hits
The council emphasized one rule: If you don't track /cost, you're not optimizing... you're guessing.
Outcome
With the full playbook implementation:
- ~60-70% reduction in token usage
- Same or better output quality
- Opus becomes usable for high value work
The developer noted this approach was more effective than any single prompt hack.
📖 Read the full source: r/ClaudeAI
👀 See Also
Vyra: Intelligent Web Video Editor for Claude Agents via MCP
Vyra indexes footage so Claude can semantically search and edit video directly—supports motion graphics, music sync, smart masking, transcript editing, color grading, and 30+ effects.
Claw Compactor: 14-stage token compression engine for LLM pipelines
Claw Compactor is an open-source LLM token compression engine using a 14-stage Fusion Pipeline to achieve 54% average compression with zero LLM inference cost. It includes specialized compressors for code, JSON, logs, diffs, and search results with reversible compression capabilities.
Log Reducer MCP Server Cuts Token Usage When Claude Code Reads Logs
Log Reducer is an MCP server that processes log files server-side before sending reduced output to Claude Code, avoiding raw logs in the context window. It applies 19 deterministic transforms that compress logs by 50-90%, with a 2000-line log representing 20,000+ tokens removed from sessions.
Skillware adds synthetic data generator with entropy scoring for local model fine-tuning
Skillware has released a new synthetic data generator skill that uses zlib compression-ratio heuristics to score output diversity, helping prevent model collapse. The tool works out-of-the-box with Ollama, supports Gemini/Anthropic for high-reasoning batches, and outputs JSON batches for .jsonl fine-tuning pipelines.