Single-page chatbot interface for locally running Gemma 4 26B A4B
A developer has created a single-page HTML chatbot interface designed to work with Gemma 4 26B A4B running locally. The implementation connects to LM Studio's API and provides a complete chatbot interface in a single HTML file.
Technical Implementation
The system runs Gemma 4 26B A4B locally with a 32K context window, achieving 50-65 tokens per second. The model is sharded between two GPUs: a 7900 XT and a 3060 Ti.
Interface Features
- Full streaming support for real-time responses
- Markdown rendering for formatted output
- Model selector for switching between available models
- Six parameter sliders for fine-tuning model behavior
- Message editing with history branching capabilities
- Regenerate function for response regeneration
- Abort button to stop generation mid-stream
- System prompt support for custom instructions
Development Details
The developer notes that Claude was used to fix two DOM bugs that Gemma couldn't resolve. All other development work was completed using Gemma 4. The project is available on GitHub for examination and use.
This type of single-page interface is particularly useful for developers working with local LLMs who want a lightweight, customizable chat interface without the overhead of complex web applications. The integration with LM Studio's API makes it compatible with various local models beyond just Gemma.
📖 Read the full source: r/LocalLLaMA
👀 See Also
oMLX introduces SSD KV caching for Apple Silicon, reducing OpenClaw response times from 30-90 seconds to 5 seconds
oMLX is a new backend that persists KV cache blocks to SSD in safetensors format, preventing cache invalidation when context shifts. This reduces OpenClaw response times from 30-90 seconds down to 5 seconds on subsequent turns.
Jean-Claude: A Satirical LLM Frontend Mocking EU AI Regulation, with 412 Cookie Partners and VAT Invoices Every 5 Messages
Jean-Claude is a satirical LLM frontend that applies extreme EU-style bureaucracy to AI usage: 412 cookie partners, four-eyes principle requiring co-signature, per-token CO₂ tracking with mandatory €offset, VAT invoices every 5 messages, and a compliance center with fake GDPR/AI Act metrics.
Claude Code Limiter: Self-Hosted Rate Limiter for Shared Claude Code Subscriptions
claude-code-limiter is a self-hostable tool that adds per-user rate limits to shared Claude Code subscriptions, featuring per-model quotas, credit budgets, sliding 24h windows, time-of-day rules, and a real-time dashboard.
