Open-Source Tool Measures AI Coding Agent Autonomy with Local Data Analysis
What Codelens-AI Does
Codelens-AI is an open-source CLI tool that reads your local Claude Code session files and correlates them with git history. Instead of just tracking cost, it analyzes how the AI agent actually works by calculating autonomy metrics based on your usage patterns.
Key Metrics and Sample Results
The creator ran the tool on 30 days of personal usage and shared these results:
- Autopilot Ratio: 7.4x — For every message sent to Claude, the agent takes 7 actions
- Self-Heal Score: 1% — Out of 6,281 bash commands, only 50 were tests or lints
- Toolbelt Coverage: 81% — The agent uses most available tools (grep, read, write, bash, search)
- Commit Velocity: 114 steps/commit — It takes 114 tool calls to produce one commit
- Overall Autonomy Score: C (36/100)
Practical Impact and Usage
These metrics revealed that while the agent works hard (7.4x Autopilot Ratio), it rarely verifies its own work (1% Self-Heal Score). This insight prompted the creator to change their prompting strategy — they now explicitly tell Claude to run tests after every edit, which increased their Self-Heal Score from 1% to approximately 15% within a few days.
Setup and Data Privacy
The tool requires zero setup: npx claude-roi. All data stays local — it parses your ~/.claude/projects/ JSONL files plus git log. There's no cloud component and no telemetry.
Development Status and Community
The tool is actively seeking feature suggestions, issues, and PRs — particularly around the scoring formula and adding support for Cursor/Codex sessions. The creator is curious what scores other people get and whether others are running this tool.
GitHub: github.com/Akshat2634/Codelens-AI
Website: https://codelensai-dev.vercel.app/
📖 Read the full source: r/ClaudeAI
👀 See Also
RubyLLM: One Ruby Framework for All Major AI Providers
RubyLLM provides a single Ruby framework for OpenAI, Anthropic, Gemini, Ollama, and 800+ models. Features chat, vision, audio, tools, agents, streaming, and Rails integration.
OpenClaw memory loss fix using Mem0 plugin
OpenClaw agents experience memory loss due to context compaction rewriting files like MEMORY.md. The Mem0 plugin solves this by moving memory outside the context window with auto-recall and auto-capture features.
Octopoda: Open Source Memory Layer for Local AI Agents
Octopoda is an open source memory layer that gives local AI agents persistent memory between sessions, semantic search, loop detection, and crash recovery. It runs fully offline with a 33MB embedding model and integrates with LangChain, CrewAI, AutoGen, and OpenAI Agents SDK.
Flue: A TypeScript Framework for Building Autonomous Coding Agents
Flue is a TypeScript framework that provides a programmable harness for building autonomous agents, featuring skills, sessions, sandboxed shell execution, and a built-in virtual sandbox. It can replace tools like Dosu, Greptile, CodeRabbit, Devin, and Claude Code with custom agent logic.