Gemma4 26B-A4B Delivers Fast Local Performance with Web Search and Image Support
Gemma4 26B-A4B Performance and Features
The gemma-4-26B-A4B model demonstrates strong performance for local use, with the source reporting speeds of approximately 145 tokens per second when running on an RTX 4090 GPU. This combination of capability and speed makes it suitable for responsive local applications.
Key Features from Source
- Model: gemma-4-26B-A4B
- Performance: ~145 t/s (tokens per second) on RTX 4090
- Integration: Web search MCP (Model Context Protocol) support
- Multimodal: Image support included
- Platforms: Setup documented for Mac and iPhone usage
The source mentions that the experience can be improved with simple tricks and a short system prompt, though specific details about these optimizations are not provided in the excerpt. The author has documented their complete setup process in a blog post that covers configuration and usage across multiple devices.
For developers interested in implementing this setup, the full configuration details, system prompts, and optimization techniques are available in the referenced blog post at the provided URL.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Brain-MCP Developer Documents Tools for Claude AI Instead of Humans
A developer maintaining the Brain-MCP server added a 'For AI Assistants' section to documentation with behavioral instructions, resulting in Claude using tools more intelligently and proactively injecting context when topics change.
llm-idle-timeout Fires at 2 Minutes on N100/WSL2 Despite timeoutSeconds Setting
A user reports that the idle watchdog in OpenClaw fires after 2 minutes on N100/WSL2 hardware, ignoring the timeoutSeconds=300 setting, due to slow gateway startup (45+ seconds) and no configurable noOutputTimeoutMs.
boxBot: An Open-Source Smart Speaker Powered by Claude and Hailo AI
A developer built a smart speaker named boxBot using Claude for agent-driven hardware control, Raspberry Pi, Hailo AI accelerator, and custom SDK—open-sourced on GitHub.
Jan-Code-4B: A Lightweight Code-Tuned Model for Local Development
The Jan team released Jan-Code-4B, a 4B parameter code-tuned model based on Jan-v3-4B-base-instruct. It's designed as a drop-in replacement for Haiku in Claude Code, offering improved coding assistance while running locally.