Voxray-AI: Production Go Backend for Real-Time Voice Agent Pipelines
Production Voice Agent Pipeline in Go
Voxray-AI provides a complete streaming pipeline in Go that handles client audio through WebSocket or WebRTC, processes it through STT → LLM → TTS, and returns audio output. The system is designed for production-grade servers and high-concurrency voice workloads.
Transport Options
The system supports multiple transport mechanisms:
- WebSocket at
/wswith RTVI serializer (?rtvi=1) and Protobuf (?format=protobuf) support - WebRTC at
/webrtc/offerwith full SDP offer/answer, configurable STUN/TURN, and Opus encoding (requires CGO build) - Telephony runner transports: Twilio, Telnyx, Plivo, Exotel, LiveKit, Daily.co
Pluggable Providers
All components are swappable via configuration:
- STT providers: OpenAI, Groq, Sarvam, Google, AWS
- LLM providers: OpenAI, Anthropic, Groq, others
- TTS providers: OpenAI, Google, AWS Polly, Sarvam
Configuration Examples
Minimal configuration example:
{"transport": "both", "stt": { "provider": "groq", "model": "whisper-large-v3" }, "llm": { "provider": "anthropic", "model": "claude-3-5-haiku" }, "tts": { "provider": "google", "voice": "en-US-Neural2-F" }}Turn-taking and voice activity detection configuration:
{"turn_detection": "silence", "vad_type": "silero", "vad_confidence": 0.7, "vad_start_secs_vad": 0.2, "vad_stop_secs": 0.8, "turn_max_duration_secs": 30, "user_idle_timeout_secs": 60}Observability & Storage
/metricsendpoint for Prometheus (request counts, latency histograms, active connection gauges)- Recording: Full session audio to S3 with configurable worker pool and format
- Transcripts: Per-message storage to Postgres or MySQL with configurable table
/healthand/readyendpoints with optional Redis session store check on/ready
Security Features
server_api_keygates/ws,/webrtc/offer,/start,/sessions/*viaAuthorization: BearerorX-API-Key- CORS allowlist configuration
- TLS cert/key configuration
- 12-factor style: JSON config + environment variable overrides
This type of backend is useful for developers building real-time voice applications that need to integrate multiple AI services with production-ready infrastructure.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Pi Coding Agent with Qwen 35B Q2: Using Filesystem as External Memory and Enforcing Context Guards
A Reddit user built a stack around Pi coding agent with Qwen 35B Q2_K_XL quant that enforces guards — rejects edits over 100 lines, caps thinking blocks at 2000 chars, and monitors context at 65%/80% — treating the filesystem as the model's memory, not the context window.
DoomVLM: Open Source Tool for Testing Vision Language Models in Doom Deathmatches
DoomVLM is now open source as a single Jupyter notebook that lets you test vision language models playing Doom via OpenAI-compatible APIs. The tool supports deathmatch modes where up to 4 models can compete, with full configuration options for system prompts, tool descriptions, and sampling parameters.
Replacing Kafka, Redis, and RabbitMQ with NATS: A Developer's Experience
A developer replaced Kafka, Redis, and RabbitMQ with NATS in their architecture, sharing specific implementation details and lessons learned from consolidating multiple messaging systems into one tool.
Femtobot: Efficient Rust Agent for Low-Resource Environments
Femtobot is a lightweight Rust-based AI agent designed to run efficiently on low-resource machines, such as older Raspberry Pis, through a ~10MB binary without large runtime dependencies.