Opendesk: MCP + SOM algorithm for AI desktop control via Claude Code
Opendesk is an open-source MCP server that lets AI agents control your entire desktop — mouse and keyboard included — using a custom Self-Organizing Map (SOM) algorithm for improved accuracy. It integrates with Claude Code or any custom agentic harness, enabling real desktop automation workflows.
Key Features
- Desktop Control: Agents can move the mouse, click, and type to interact with any application or website.
- Learn & Replay: Record a sequence of actions (e.g., logging into a dashboard and exporting a report) and replay it later on command.
- Scheduling: Run computer-use tasks automatically at specific times — for example, every morning at 9am open Gmail and summarize unread emails.
Example Commands
- “Open Spotify and play a lofi playlist”
- “Go to Twitter and like the first 3 posts on my feed”
- “Fill out this form on Chrome”
Integration
Works with Claude Code and any custom agentic harness that supports MCP. The SOM algorithm improves click/target accuracy compared to vanilla computer-use implementations.
Get Started
Source and documentation available on GitHub: github.com/vitalops/opendesk
📖 Read the full source: r/ClaudeAI
👀 See Also
ANE Optimization Through Phone-Steered AI Experiments Shows Kernel Fusion Benefits
A developer ran 55 experiments on Apple Neural Engine optimization, steering the process from their phone using Claude for brainstorming. Key improvements included fusing 3 ANE kernels into 1 mega-kernel, reducing validation loss from 3.75 to 2.49 and step time from 176ms to 96ms.
OpenClaw Skill Usage Tracker: Monitor Which Skills You Actually Use
A developer built a tool to track OpenClaw skill usage analytics, including invocation counts, breakdowns by agent and channel, and top skill rankings over different time periods.
W2A — an open protocol for agent sensors: giving local agents real-time perception
W2A (World2Agent) is an open protocol standardizing the perception layer for AI agents — self-hostable, TS SDK, Apache 2.0. It lets agents receive real-time signals from sensors without one-off scripts.
Developer Creates Practical Claude Skills for Kotlin Multiplatform Projects
A developer built a public repository of Claude skills specifically for Kotlin Multiplatform work after finding existing skills too generic, opinionated, or thin. The skills cover architecture reviews, feature implementation, modularization, Compose Multiplatform UI, navigation, platform bridges, deep links, adaptive UI, testing, and build governance.