Building a Jarvis-Style AI with MCP and Open Models
A developer on r/LocalLLaMA shared a Jarvis-style AI assistant built using the Model Context Protocol (MCP) and open models. The system is still work in progress but already supports several agentic features.
Key Details
- Memory — persistent context across sessions
- Autonomous file editing — the AI can read and write files on its own
- Visible tool-call tracing — users can see each step the AI takes
- Confirmation before dangerous actions — safety guardrails for destructive operations
- Persistent context — maintains state over time
- Hybrid local/cloud inference — can switch between local and cloud models
The primary model is Qwen3-Coder 480B running in the cloud for reasoning and tool usage, because smaller local models hallucinate too much with MCP workflows. The user is now working on Windows UI automation, dynamic skills, and AI-generated skill creation so the assistant can expand its own capabilities. The goal is a practical AI operator that interacts with and automates the user's computer, not just another chatbot.
Who It's For
Developers experimenting with local AI agents, MCP-based tool use, and autonomous computer automation using open-weight models.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Netflix Releases VOID: Video Object and Interaction Deletion Model on Hugging Face
Netflix has released VOID, a video inpainting model that removes objects from videos along with all physical interactions they induce, including falling objects and displaced items. The model requires a GPU with 40GB+ VRAM and uses quadmask conditioning with two checkpoint files for different refinement levels.
PeaDB: Redis-Compatible Database Coded with AI Assistants in C++20
A developer created PeaDB, a Redis 7.2.5 drop-in replacement written in C++20 using Codex, Copilot, and Claude, implementing ~147 commands with persistence, replication, and cluster support. Benchmarks show performance close to Redis.
CK Search: Local Semantic Search Tool with MCP Server Integration
CK Search is a local semantic search tool with a built-in MCP server that indexes any text directory without cloud dependencies. The tool can be used by AI agents via MCP, and the source provides a practical walkthrough covering setup, strengths, and limitations compared to grep.
Managing Multiple AI Agent Tasks with Kanban Boards
A developer shares their experience running multiple Claude AI agents in terminal tabs and identifies three key workflow challenges: lack of progress visibility, context loss when switching between tasks, and rate limit interruptions. Their solution involves treating AI tasks like work items on a Kanban board.