Single-page chatbot interface for locally running Gemma 4 26B A4B
A developer has created a single-page HTML chatbot interface designed to work with Gemma 4 26B A4B running locally. The implementation connects to LM Studio's API and provides a complete chatbot interface in a single HTML file.
Technical Implementation
The system runs Gemma 4 26B A4B locally with a 32K context window, achieving 50-65 tokens per second. The model is sharded between two GPUs: a 7900 XT and a 3060 Ti.
Interface Features
- Full streaming support for real-time responses
- Markdown rendering for formatted output
- Model selector for switching between available models
- Six parameter sliders for fine-tuning model behavior
- Message editing with history branching capabilities
- Regenerate function for response regeneration
- Abort button to stop generation mid-stream
- System prompt support for custom instructions
Development Details
The developer notes that Claude was used to fix two DOM bugs that Gemma couldn't resolve. All other development work was completed using Gemma 4. The project is available on GitHub for examination and use.
This type of single-page interface is particularly useful for developers working with local LLMs who want a lightweight, customizable chat interface without the overhead of complex web applications. The integration with LM Studio's API makes it compatible with various local models beyond just Gemma.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Sylve: A FreeBSD Management Plane for Virtualization, Containers, and Storage
Sylve is a BSD-2 licensed management plane for FreeBSD that provides unified control over Bhyve VMs, FreeBSD Jails, ZFS storage, and networking. It uses a RAFT consensus model for clustering and includes Samba share management with ZFS snapshot automation.
Open Source Second Brain System Built on Claude Code for Task Management
An open source system called Kipi System uses Claude Code to track open threads, draft follow-ups, and manage tasks by pulling from calendar, email, CRM, and social feeds. It generates a daily HTML file with pre-written actions sorted by friction.
FFF - Fast File Finder claims 100x speed advantage over ripgrep
FFF (Fast File Finder) is a web-based file search tool that claims to be 100x faster than ripgrep, positioning itself as a next-generation alternative to regex-based search methods. The tool requires JavaScript to run and was recently discussed on Hacker News with 36 points and 17 comments.
Open-source web dashboard tracks Claude token usage for remote workflows
A developer built react-ai-token-monitor, a lightweight web dashboard that parses local Claude project files in real-time to calculate costs, show model breakdowns, and track usage patterns. The tool revealed $4,808 worth of Claude tokens consumed in March 2026 on a Max 20x plan.