Gemma4 26B-A4B Delivers Fast Local Performance with Web Search and Image Support
Gemma4 26B-A4B Performance and Features
The gemma-4-26B-A4B model demonstrates strong performance for local use, with the source reporting speeds of approximately 145 tokens per second when running on an RTX 4090 GPU. This combination of capability and speed makes it suitable for responsive local applications.
Key Features from Source
- Model: gemma-4-26B-A4B
- Performance: ~145 t/s (tokens per second) on RTX 4090
- Integration: Web search MCP (Model Context Protocol) support
- Multimodal: Image support included
- Platforms: Setup documented for Mac and iPhone usage
The source mentions that the experience can be improved with simple tricks and a short system prompt, though specific details about these optimizations are not provided in the excerpt. The author has documented their complete setup process in a blog post that covers configuration and usage across multiple devices.
For developers interested in implementing this setup, the full configuration details, system prompts, and optimization techniques are available in the referenced blog post at the provided URL.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Routerly: Self-Hosted LLM Gateway with Runtime Routing Policies and Budget Control
Routerly is a free, open-source, self-hosted LLM gateway that provides runtime model selection based on routing policies like cheapest, fastest, or most capable, along with project-level budget limits with per-token tracking. It's OpenAI-compatible for drop-in use with tools like Cursor, LangChain, and Open WebUI.
SimplePDF Copilot: Client-Side AI Tool Calling for PDF Form Filling
SimplePDF Copilot uses client-side tool calling to let an LLM fill fields, add fields, delete pages, and more in PDFs — without the PDF leaving the browser.
Agents Elements: A macOS Dashboard for Claude Code & Codex Installations
A native SwiftUI macOS app that scans ~/.claude and ~/.codex to show installed skills, subagents, commands, plugins, MCP servers, hooks, and session status with token usage.
OpenClawDreams: A Dream Simulator Extension for OpenClaw Agents
OpenClawDreams is an extension that adds a background reflection process and nightly dream cycle to OpenClaw agents. It captures encrypted conversation summaries to a local SQLite database, processes them during background cycles, and generates consolidated insights that get pushed into the agent's persistent memory.