Local Voice Control Setup for AI Agents on Apple Silicon
This setup details how to implement local voice control for AI agents using Parakeet STT and Kokoro TTS on Apple Silicon, specifically tested on a Mac Mini M4. The goal was to achieve a fully local and fast voice interaction layer, eliminating dependencies on cloud services.
Key Details
- Hardware: Mac Mini M4 running OpenClaw + Claude as the AI agent.
- Software Setup: Parakeet for speech-to-text (STT) which transcribes voice input in approximately 240ms, and Kokoro for text-to-speech (TTS) that provides nearly instant responses.
- Benefits: Transitioning from typing to voice commands significantly enhances workflow flexibility, allowing for office-independent operation, such as from the balcony or while walking a dog.
- Challenges: Occasionally, the STT struggles with accent recognition, humorously leading to the AI agent correcting the user’s pronunciation.
- Enhancements: A browser extension incorporating a 3D avatar named Mimora enables visual interaction, showing various expressions like listening, thinking, and happy states during agent responses.
This configuration is ideal for those seeking cloud-independent, fast voice interaction with AI agents, particularly using Apple Silicon hardware.
📖 Read the full source: r/LocalLLaMA
👀 See Also
bareguard: A Lightweight Safety Gate for AI Agents — Now on npm
bareguard v1.0 is a ~1000-line, single-dependency safety layer for AI agents that blocks destructive actions (rm -rf, DROP TABLE) and enforces budget limits with human escalation. Part of the bare suite, live on npm.
Monarch v3: NES-Inspired KV Paging for 78% Faster LLM Inference
Monarch v3 implements NES-inspired memory paging for transformers, achieving 78% faster inference (17.01 to 30.42 tok/sec) on a 1.1B parameter model with nearly zero VRAM overhead. The open-source algorithm splits KV cache into hot and cold regions with compression and promotion mechanisms.
Open-source MCP server bridges Claude Code with IDE tools
An open-source MCP server gives Claude Code persistent access to IDE features including LSP, terminals, Git, GitHub, debugging, and diagnostics through 124+ tools. It enables coding from mobile devices when a machine is set up.
Dual DGX Sparks vs Mac Studio M3 Ultra: Practical Comparison for Running Qwen3.5 397B Locally
A developer compared running Qwen3.5 397B locally on a $10K Mac Studio M3 Ultra 512GB and a $10K dual DGX Spark setup. The Mac Studio achieved 30-40 tok/s with 800 GB/s bandwidth but slow prefill, while the Sparks delivered 27-28 tok/s with faster compute but complex setup.