Opendesk: MCP + SOM algorithm for AI desktop control via Claude Code
Opendesk is an open-source MCP server that lets AI agents control your entire desktop — mouse and keyboard included — using a custom Self-Organizing Map (SOM) algorithm for improved accuracy. It integrates with Claude Code or any custom agentic harness, enabling real desktop automation workflows.
Key Features
- Desktop Control: Agents can move the mouse, click, and type to interact with any application or website.
- Learn & Replay: Record a sequence of actions (e.g., logging into a dashboard and exporting a report) and replay it later on command.
- Scheduling: Run computer-use tasks automatically at specific times — for example, every morning at 9am open Gmail and summarize unread emails.
Example Commands
- “Open Spotify and play a lofi playlist”
- “Go to Twitter and like the first 3 posts on my feed”
- “Fill out this form on Chrome”
Integration
Works with Claude Code and any custom agentic harness that supports MCP. The SOM algorithm improves click/target accuracy compared to vanilla computer-use implementations.
Get Started
Source and documentation available on GitHub: github.com/vitalops/opendesk
📖 Read the full source: r/ClaudeAI
👀 See Also
Transcribe Media: Open-Source Skill for YouTube, Podcast & Local Audio/Video
Transcribe Media is an open-source OpenClaw skill that finds existing captions, falls back to transcription, and supports local MP3/MP4/WAV/M4A/WebM. Requires approval for remote transcription.
GitHub Comic Bot: Turn Commits into Daily Medieval Knight Comics
A bot that reads GitHub commits and generates 4-panel comic strips featuring a deadpan medieval knight, built with Claude Code and Gemini, running on GitHub Actions with free tier costs.
Omnara: Run Claude Code and Codex from Anywhere
Omnara is a web and mobile IDE that lets developers run and interact with Claude Code and Codex sessions from anywhere, with features like cloud syncing and a voice agent.
Claude Hindsight: Observability Tool for Claude Code Sessions
Claude Hindsight is an open-source observability layer for Claude Code that captures tool calls, tokens, and errors into an explorable dashboard. The creator used it to refactor an open-source project in a single 11-hour session with 733 tool calls and 692.8M cache tokens.