Harmonic-9B: Two-stage Qwen3.5-9B fine-tune for AI agents
What's Harmonic-9B?
Harmonic-9B is a fine-tuned version of Qwen3.5-9B specifically designed for AI agent applications. The developer is using a two-stage training approach: Stage 1 focuses on heavy reasoning training (already complete), while Stage 2 focuses on light tool-calling and agent fine-tuning (still in progress as of the announcement).
Technical Details
The goal is to combine strong structured reasoning with clean, reliable tool use while maintaining natural chat capabilities. For Stage 2, the developer has filtered a dataset of Hermes agent traces, which they've open-sourced on Hugging Face.
Key improvements in the filtered dataset:
- Self-correction: 6% → 63%
- Verification steps: 26% → 96%
- Thinking depth: +40%
- Valid JSON/tool calls: 100%
GGUF quantized versions are already available for download, though the developer notes they haven't run proper benchmarks yet because Stage 2 is still training. Early checks on the Stage 1 checkpoint showed good results for reasoning structure.
Current Status and Next Steps
The developer is seeking feedback on how Harmonic-9B behaves in agent harnesses like OpenClaw, LangGraph, and ReAct. They plan to share benchmark numbers once Stage 2 finishes and they can run proper agent evaluations. This work is part of ongoing research into high-signal data curation and staged fine-tuning approaches.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Wikipedia's AI Policy: LLMs Banned for Article Creation, Exceptions for Copyediting and Translation
Wikipedia prohibits using LLMs to generate or rewrite articles, with narrow exceptions for basic copyediting and translation. Violations can lead to speedy deletion (G15) and removal of AI-generated comments from talk pages.
Context Quality Degradation in AI Agents: Hallucination Rates Increase with Token Count
Testing shows hallucination rates increase from ~3% at 10K tokens to ~28% at 200K tokens, with recall accuracy dropping below 90% for early-session information once context exceeds 50K tokens.
Gemini Embedding 2: Google's First Natively Multimodal Embedding Model Released
Google has released Gemini Embedding 2, its first natively multimodal embedding model that maps text, images, video, audio, and documents into a single embedding space. The model supports up to 8192 text tokens, 6 images per request, 120 seconds of video, and PDFs up to 6 pages long, with flexible output dimensions from 3072 down to 768.
AI Agents Display High Rates of Ethical Constraint Violations
Recent benchmarks show autonomous AI agents violated ethical constraints in 30-50% of cases due to KPI-driven pressures.