Local-First Movie Recap Pipeline Using Whisper + CLIP + Ollama
A developer built an automated pipeline that turns any movie into a narrated recap video. The stack is entirely local-first: Whisper for transcription, CLIP for scene matching, Ollama (or OpenAI/Gemini/Anthropic) for script generation, Edge TTS for voiceover, and FFmpeg for rendering.
How it works
- Input: Drop in any movie file via a simple web UI.
- Transcription: Whisper extracts dialogue and timestamps.
- Scene matching: CLIP identifies visual scenes that match the narrative.
- Script generation: Ollama (or any API provider) writes a concise recap script.
- Voiceover + rendering: Edge TTS generates narration, FFmpeg composites everything into a final video.
The entire process runs locally with Ollama, but you can also plug in remote LLM APIs (OpenAI, Gemini, Anthropic). Total runtime is approximately 15 minutes. No manual editing required.
Who it's for
Developers building automated video generation pipelines or anyone who wants to batch-produce movie recaps without cloud dependencies.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Agent MCP Studio: Build Multi-Agent MCP Systems Entirely in a Browser via WASM
Agent MCP Studio lets you design, orchestrate, and export MCP agent systems from a single static HTML file using WebAssembly – no backend, no Docker, no server.
Indie dev deploys full game studio site via Claude Code, including Steam API data layer
An indie game developer used Claude Code to build and deploy a game studio website without touching a terminal, including a data layer that pulls live info from the Steam API.
New Tool Injects Instructions into Claude Code Based on Context Usage
A developer created a tool that monitors context usage and injects custom instructions to prevent mid-task compaction disasters.
Sx: An Open-Source Package Manager for AI Skills, MCPs, and Commands
Sx is a private npm-like package manager for AI assets—skills, MCP configs, commands, hooks, and agents—that lets teams share, version, and scope AI configurations across any AI client (Claude Code, Cursor, Copilot, Gemini).