Multi-Agent Career Mentor Built with Ollama and MCP for Local AI
A developer has built a multi-agent AI system called "AI Career Mentor" that reads resumes and produces comprehensive career intelligence reports. The system runs fully locally using Ollama with llama3, requiring no API keys or external costs.
Technical Architecture
The system consists of five specialized agents that chain their outputs:
- Each agent receives the previous agent's output as shared context
- The roadmap agent knows your skill gaps from the analysis agent
- The salary agent knows your roadmap from the previous agent
- This chaining makes the report progressively smarter as it moves through the pipeline
Tech Stack Details
- AI Engine: Ollama + llama3 (100% local)
- RAG System: FAISS + SentenceTransformers for indexing your knowledge base
- Tool Layer: MCP (Model Context Protocol) - FastAPI spawns the MCP server as a subprocess and communicates via stdio JSON-RPC
- Resume Processing: pdfplumber for reading PDF resumes
- Frontend: React
MCP Implementation Notes
The developer found MCP particularly interesting to build. MCP is Anthropic's open standard for connecting AI to tools, using one server that can work with any client. The system also connects to Claude Desktop via configuration file, allowing Claude to call all 9 tools directly.
A notable bug encountered: MCP SDK v1.x changed handler signatures completely. Old code passes a full request object, while new code unpacks name and arguments directly. This caused significant debugging time.
Report Outputs
The system generates a complete career intelligence report including:
- Resume analysis
- Skill gap identification
- 6-month roadmap
- Salary strategy
- Interview preparation
All components run in one shot after processing the resume.
Resources
The project is available on GitHub with a video walkthrough. The developer notes that the RAG setup and MCP client/server wiring were the trickiest parts to implement.
📖 Read the full source: r/LocalLLaMA
👀 See Also
LLM Cost Profiler: Open-source tool tracks API spending to make case for local models
LLM Cost Profiler is a Python tool that tracks every API call to OpenAI/Anthropic, showing exactly what you're spending and where. It exposes tasks that are overpriced relative to their complexity, providing concrete dollar amounts to justify moving to local models.
Layered Defense Framework for Claude Code Rule Enforcement
An IT operations professional built an 8-layer defense framework to enforce Claude Code rules after discovering that both CLAUDE.md prompts and blocking hooks could be bypassed. The approach adapts the Swiss cheese model from accident investigation to prevent workarounds.
Mouse: Coordinate-Based Editing Staged Changes and Atomic Rollback for AI Coding Agents
Mouse replaces string-replacement editing with six coordinate-based operations (INSERT, DELETE, ADJUST) plus staged changes with atomic rollback for AI agents.
Claude Cowork mode explained: file-level task execution vs chat and code modes
Claude's Cowork mode operates inside a chosen folder to perform file-level tasks like organizing messy folders, extracting structured data from screenshots, and combining scattered notes into structured documents.