Open-Source Tool Measures AI Coding Agent Autonomy with Local Data Analysis
What Codelens-AI Does
Codelens-AI is an open-source CLI tool that reads your local Claude Code session files and correlates them with git history. Instead of just tracking cost, it analyzes how the AI agent actually works by calculating autonomy metrics based on your usage patterns.
Key Metrics and Sample Results
The creator ran the tool on 30 days of personal usage and shared these results:
- Autopilot Ratio: 7.4x — For every message sent to Claude, the agent takes 7 actions
- Self-Heal Score: 1% — Out of 6,281 bash commands, only 50 were tests or lints
- Toolbelt Coverage: 81% — The agent uses most available tools (grep, read, write, bash, search)
- Commit Velocity: 114 steps/commit — It takes 114 tool calls to produce one commit
- Overall Autonomy Score: C (36/100)
Practical Impact and Usage
These metrics revealed that while the agent works hard (7.4x Autopilot Ratio), it rarely verifies its own work (1% Self-Heal Score). This insight prompted the creator to change their prompting strategy — they now explicitly tell Claude to run tests after every edit, which increased their Self-Heal Score from 1% to approximately 15% within a few days.
Setup and Data Privacy
The tool requires zero setup: npx claude-roi. All data stays local — it parses your ~/.claude/projects/ JSONL files plus git log. There's no cloud component and no telemetry.
Development Status and Community
The tool is actively seeking feature suggestions, issues, and PRs — particularly around the scoring formula and adding support for Cursor/Codex sessions. The creator is curious what scores other people get and whether others are running this tool.
GitHub: github.com/Akshat2634/Codelens-AI
Website: https://codelensai-dev.vercel.app/
📖 Read the full source: r/ClaudeAI
👀 See Also
CogniLayer: An MCP Server for Persistent Memory in Claude Code
CogniLayer is an open-source MCP server that provides Claude Code with persistent memory across sessions using a SQLite database with FTS5 full-text search and vector embeddings. It solves the problem of Claude forgetting project context between sessions.
Memento Vault: Local Tool for Persistent Context in Claude Code Sessions
Memento Vault is a set of hooks that automatically captures session transcripts, scores them, and stores atomic notes in a local git repo. It provides zero-cost retrieval via BM25 + vector search with 472ms average latency and injects relevant context at session start, on every prompt, and on file reads.
Tripsy Launches MCP Server for Claude: Manage Trips via Structured API
Tripsy's official MCP server lets Claude directly read, create, and update trips, activities, stays, transportation, and expenses. Setup takes ~1 minute via Claude's custom connector.
OpenClaw users report planning and review bottlenecks with AI agents
OpenClaw users describe planning and review workflows as 'MS-DOS-like' despite effective code generation, citing manual intervention, document fragmentation, and loss of reasoning during agent collaboration. Some are experimenting with agent-native document editors like comment.io and Proof by Every.