Open-Source Tool Measures AI Coding Agent Autonomy with Local Data Analysis
What Codelens-AI Does
Codelens-AI is an open-source CLI tool that reads your local Claude Code session files and correlates them with git history. Instead of just tracking cost, it analyzes how the AI agent actually works by calculating autonomy metrics based on your usage patterns.
Key Metrics and Sample Results
The creator ran the tool on 30 days of personal usage and shared these results:
- Autopilot Ratio: 7.4x — For every message sent to Claude, the agent takes 7 actions
- Self-Heal Score: 1% — Out of 6,281 bash commands, only 50 were tests or lints
- Toolbelt Coverage: 81% — The agent uses most available tools (grep, read, write, bash, search)
- Commit Velocity: 114 steps/commit — It takes 114 tool calls to produce one commit
- Overall Autonomy Score: C (36/100)
Practical Impact and Usage
These metrics revealed that while the agent works hard (7.4x Autopilot Ratio), it rarely verifies its own work (1% Self-Heal Score). This insight prompted the creator to change their prompting strategy — they now explicitly tell Claude to run tests after every edit, which increased their Self-Heal Score from 1% to approximately 15% within a few days.
Setup and Data Privacy
The tool requires zero setup: npx claude-roi. All data stays local — it parses your ~/.claude/projects/ JSONL files plus git log. There's no cloud component and no telemetry.
Development Status and Community
The tool is actively seeking feature suggestions, issues, and PRs — particularly around the scoring formula and adding support for Cursor/Codex sessions. The creator is curious what scores other people get and whether others are running this tool.
GitHub: github.com/Akshat2634/Codelens-AI
Website: https://codelensai-dev.vercel.app/
📖 Read the full source: r/ClaudeAI
👀 See Also
Local PII Redaction Skill for OpenClaw Uses GLiNER Model
A new OpenClaw skill intercepts outgoing responses and runs them through the local nvidia/gliner-PII model to detect and redact sensitive information like API keys and PII, replacing them with labels like [API_KEY] and adding removal notices.
CodeLedger and Vibecop Updates for Multi-Agent AI Coding Cost and Quality Tracking
CodeLedger now tracks spending across Claude Code, Codex CLI, Cline, and Gemini CLI by reading local session files, while Vibecop adds automated quality checks with new LLM-specific detectors and a one-command setup for multiple AI coding tools.
repo-mem: Open-Source MCP Server Adds Persistent Team Memory to Claude Code
repo-mem is an open-source MCP server that adds persistent, shared memory to Claude Code sessions using SQLite and Git. It solves team isolation by storing observations in per-user databases that get committed to the repository.
CLAUDE.md: Drop-in file reduces Claude output tokens by 63%
CLAUDE.md is a single file that cuts Claude output verbosity by approximately 63% without code changes. It targets sycophancy, verbosity, and formatting noise in Claude's responses.