LetMeWatch: Python Plugin Adds Video Analysis to Claude via FFmpeg Scene Detection
A developer has created a Python plugin called LetMeWatch that enables Claude to analyze video content despite its lack of native video support. The tool addresses the specific use case of sending screen recordings of bugs to Claude for diagnosis.
How It Works
The plugin uses FFmpeg scene detection to extract only frames where the visuals actually change. It timestamps each extracted frame and feeds them to Claude in batches. This approach avoids using AI video models or complex infrastructure—it relies on frame extraction combined with Claude's existing multimodal vision capabilities.
Technical Implementation
- Written in Python (~200 lines of code)
- Uses FFmpeg for scene detection
- Extracts frames only when visual changes occur
- Adds timestamps to each frame
- Sends frames to Claude in batches
- Works on all platforms
- Open source (available on GitHub)
Practical Application
The developer tested the tool by recording a bug in a todo app and running the command /video-last. Claude successfully identified the exact line with the typo from watching the recording. This demonstrates how the tool can be used for debugging by having Claude analyze screen recordings of issues.
The project is available at github.com/BinyaminEden/letmewatch and represents a practical workaround for Claude's current video limitations using existing tools and Claude's vision capabilities.
📖 Read the full source: r/ClaudeAI
👀 See Also
VT Code: Open-Source Rust TUI Coding Agent with Multi-Provider Support and Agent Skills
VT Code is a Rust-based terminal UI (TUI) coding agent supporting Anthropic, OpenAI, Gemini, and Codex, with local inference via LM Studio and Ollama. It includes Agent Skills, Model Context Protocol, and Agent Client Protocol.
10.33 t/s on Qwen 3.5 35B with a $300 Laptop: Full Optimization Breakdown
A developer achieves 10.33 t/s on Qwen 3.5 35B Q4_K_S on a Lenovo Ideapad Slim 3i ($300) using ik_llama.cpp, core pinning, MTP speculative decoding, and BIOS performance tuning.
Gemini 3.1 Pro in Multi-Agent Systems: High Design Quality, 20% Tool-Call Failure Rate
Developers building Bobr, an AI presentation generator with a multi-agent architecture, report Gemini 3.1 Pro produces impressive design output but suffers from a ~20% tool-call failure rate and garbled text corruption in production pipelines.
VTCode: A Rust TUI Coding Agent That Aggressively Trims Context with AST-Level Chunking
VTCode is an open-source Rust TUI coding agent that aggressively trims context using AST-level chunking via ripgrep and ast-grep. It supports custom OpenAI-compatible providers, sandboxing with macOS Seatbelt and Linux Landlock, and tree-sitter-bash validation on generated commands.