Skillware adds prompt_rewriter for deterministic token compression in Claude API agent loops
Skillware has added a prompt_rewriter skill that reduces Claude API costs in agentic loops by compressing prompts before sending them to the LLM. The middleware uses heuristic compression to cut token usage by 50-80% while maintaining deterministic behavior across iterations.
How it works
The tool operates as middleware that sits between your agent and the Claude API. It applies aggressive compression to prompts before they're sent to the LLM, ensuring you only pay for the signal and not the noise. Because the compression is deterministic, agent behavior remains stable across loops.
Compression levels
- Low: Normalizes whitespace
- Medium: Strips conversational fillers (please, ensure, etc.)
- High: Aggressively removes stop-words and non-essential punctuation
The tool addresses the problem of runaway costs in iterative agent loops where massive context windows lead to massive bills. It's open-source and available on GitHub, with the developer looking for more skills, feedback, ideas, and contributions.
📖 Read the full source: r/ClaudeAI
👀 See Also
Governor: A Claude Code Plugin to Cut Token Waste via Output Compression, Context Slimming, and Tool Filtering
Governor is a Claude Code plugin that reduces token/context waste through compact professional output, memory file compression, tool-output filtering, and drift guardrails. Benchmarks show 55.5% output token savings vs control.
NexQuant: Rust-native 3-bit KV-cache engine for edge deployment
NexQuant is a production-hardened Rust engine that enables running high-context models on consumer hardware with 3-5x memory reduction. It supports Metal, CUDA, Vulkan, and CPU backends.
Fine-tuned Qwen3.5-2B with RAG-Engram architecture improves grounded answer accuracy from 50% to 93% at 8K context
A developer fine-tuned Qwen3.5-2B with a custom RAG-Engram architecture to address the 'lost in the middle' phenomenon, improving correct answers at 8K tokens from 50% to 93% on real-world queries. The system uses a two-level approach with static entity embeddings and dynamic chunk navigation.
Bifrost AI Gateway: Open-Source Tool Addresses AI Infrastructure Gaps
Bifrost is an open-source Go-based LLM gateway that provides automatic failover between providers, budget caps that reject requests, audit logging, and hooks for evaluation. Benchmarks show it's ~50x faster than LiteLLM at high throughput.