Omnicoder-9B Performance Review: Speed vs. Tool Calling Issues
Technical Overview
Omnicoder-9B is a coding-specific model developed by Tesslate, based on the Qwen 3.5 architecture. It's fine-tuned on top of Qwen3.5 9B using outputs from multiple models including Opus 4.6, GPT 5.4, GPT 5.3 Codex, and Gemini 3.1 Pro.
Performance Characteristics
The model demonstrates strong performance on mid-tier hardware. With 12GB of VRAM, users report consistent token generation at 15 tokens/second even with context size set to 100k. Prompt processing is notably fast at approximately 265 tokens/second. The model runs without crashing systems or causing performance degradation.
Limitations and Issues
Despite the speed advantages, Omnicoder-9B shows several limitations in practical coding scenarios:
- Failed to generate a complete Super Mario clone in a standalone HTML file with a one-shot prompt
- Experienced tool calling failures with MCP servers, generating MCP errors during data fetching
- Issues executing write tool calls from Claude Code, though this may involve compatibility factors
IDE Integration Testing
Testing in development environments revealed mixed results:
- In LM Studio with Roo Code: Disconnections occurred as token size increased to 4k, though this appears to be an integration issue rather than model-specific
- The model successfully updated or wrote small scripts with token sizes between 2-3k
- API requests failed for tokens above 4k without error messages
- In Claude Code: Token generation felt slower compared to Roo Code, and the model failed to execute write tool calls after generating output
The user notes that Roo Code has been the most effective extension for local LLMs among Continue and other tested options.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Sponsio: Deterministic Guard Rails for OpenClaw — Blocking 'Legal but Wrong' Tool Calls
Open-source tool that sits at the tool boundary, evaluating each call with temporal logic contracts (~0.14ms p50). Prevents agents from editing files outside the working directory, force-pushing, or running migrations against the wrong database.
Logira: eBPF Runtime Auditing for AI Agent Runs
Logira is an observe-only Linux CLI tool that records exec, file, and network events via eBPF during AI agent runs, with per-run local storage in JSONL and SQLite and built-in detection rules for credential access, persistence changes, and suspicious patterns.
jsongrep: A DFA-Based JSON Query Tool That Outperforms jq in Benchmarks
jsongrep is a Rust-based command-line tool for querying JSON documents using a regular language syntax that compiles to deterministic finite automata (DFA), achieving faster search times than jq, jmespath, jsonpath-rust, and jql in benchmarks.
OpenClaw vs Hermes: Choose the Right Self-Hosted AI Agent After 100+ Deployments
After deploying 100+ AI agents for clients, a Reddit user shares hard-won lessons: OpenClaw (149K stars) is the reliable workhorse for single/small fleets; Hermes excels at multi-agent orchestration but has a smaller community.