Building a Local Voice AI Assistant with SwiftUI and CSM-1B on Apple Silicon
A developer shared their side project mobiGlas, a SwiftUI app that turns an OpenClaw AI assistant into a hands-free voice companion. The app runs entirely on Apple Silicon with local speech-to-text, local LLM, and local voice cloning using CSM-1B — no cloud dependencies.
Key Details
- Trigger: Say "Hey Skippy" into AirPods to start a conversation.
- Voice: Uses CSM-1B voice cloning model running locally on an M2 Ultra. Generates ~15 seconds of audio in about 7 seconds.
- Stack:
- OpenClaw — AI assistant framework running on Mac
- mobiGlas — SwiftUI app with real-time speech-to-text and text-to-speech
- CSM-1B — Local voice cloning model
- AirPods — hands-free audio I/O
- Status: v0.1 (described as "janky but functional"). The feel of walking around having a conversation with AI is reportedly "genuinely wild."
- Voice example: The developer cloned the voice of R.C. Bray (narrator of Expeditionary Force) as the assistant "Skippy."
Next Steps
The developer plans to smooth the experience for daily use cases like news briefings, reminders, and talking through ideas out loud.
If you're experimenting with local voice AI on Apple Silicon, the developer is looking to compare notes.
📖 Read the full source: r/openclaw
👀 See Also
antirez's DS4: Running DeepSeek V4 Flash with 1M Context on Mac Metal and DGX
Redis creator Salvatore Sanfilippo released DS4, a project to run DeepSeek V4 Flash with a 1M context window on Mac Metal hardware and DGX, with OpenAI/Anthropic endpoints for agentic coding tools.
OpenClaw Claude Extension Updated to Use Agent SDK After Anthropic Billing Changes
An OpenClaw extension developer rewrote their Claude CLI integration to use the official claude-agent-sdk after Anthropic started detecting and reclassifying CLI usage as third-party app usage, which bills against a separate credit pool instead of Max plan limits. The SDK approach authenticates through existing Claude Code login and bills as regular Max plan usage.
Godogen: Claude Code Skills for Complete Godot Game Generation
Godogen is an open-source pipeline that uses Claude Code skills to generate complete, playable Godot 4 projects from text prompts. It handles architecture design, 2D/3D asset generation, GDScript writing, and visual QA testing, addressing specific engineering bottlenecks like GDScript training data scarcity and build-time vs runtime state issues.
Forge: A Claude-based IDE with automated verification and project DNA
Forge is a Claude-based IDE built on VS Code that automatically runs type checking, tests, coverage checks, and import validation before showing code. It includes self-healing loops for failed verification and builds a Project DNA of your codebase patterns.