Local-First Movie Recap Pipeline Using Whisper + CLIP + Ollama

✍️ OpenClawRadar📅 Published: May 3, 2026🔗 Source
Local-First Movie Recap Pipeline Using Whisper + CLIP + Ollama
Ad

A developer built an automated pipeline that turns any movie into a narrated recap video. The stack is entirely local-first: Whisper for transcription, CLIP for scene matching, Ollama (or OpenAI/Gemini/Anthropic) for script generation, Edge TTS for voiceover, and FFmpeg for rendering.

How it works

  • Input: Drop in any movie file via a simple web UI.
  • Transcription: Whisper extracts dialogue and timestamps.
  • Scene matching: CLIP identifies visual scenes that match the narrative.
  • Script generation: Ollama (or any API provider) writes a concise recap script.
  • Voiceover + rendering: Edge TTS generates narration, FFmpeg composites everything into a final video.

The entire process runs locally with Ollama, but you can also plug in remote LLM APIs (OpenAI, Gemini, Anthropic). Total runtime is approximately 15 minutes. No manual editing required.

Who it's for

Developers building automated video generation pipelines or anyone who wants to batch-produce movie recaps without cloud dependencies.

📖 Read the full source: r/LocalLLaMA

Ad

👀 See Also

OpenClaw extension routes requests through Claude Code CLI instead of API
Tools

OpenClaw extension routes requests through Claude Code CLI instead of API

An OpenClaw extension spawns the Claude CLI binary as a subprocess, routing requests through Claude Code CLI instead of the Anthropic API. This provides the full Claude Code experience at the flat rate of a max plan.

OpenClawRadar
Custom WhatsApp Channel Plugin for Claude Code Using Baileys
Tools

Custom WhatsApp Channel Plugin for Claude Code Using Baileys

A developer built a custom channel plugin that adds WhatsApp support to Claude Code 2.1.80+ using Baileys v7, implementing the WhatsApp Web Multi-Device protocol as an MCP server with the experimental claude/channel capability.

OpenClawRadar
Chapper: Native iOS Client for LM Studio, Ollama, and OpenAI-Compatible Local Models
Tools

Chapper: Native iOS Client for LM Studio, Ollama, and OpenAI-Compatible Local Models

Chapper is a native SwiftUI iOS app that connects to LM Studio, Ollama, and OpenAI-compatible local models without cloud services or accounts. It offers real-time token streaming, full sampling controls, reasoning model support with <think> tags, and export in 7 formats.

OpenClawRadar
Claude-Code v2.1.111 adds Opus 4.7 xhigh effort, /ultrareview, and PowerShell tool
Tools

Claude-Code v2.1.111 adds Opus 4.7 xhigh effort, /ultrareview, and PowerShell tool

Claude-Code v2.1.111 introduces the Opus 4.7 xhigh effort level between high and max, adds the /ultrareview command for cloud-based multi-agent code reviews, and begins rolling out PowerShell tool support on Windows. The update also includes interactive /effort controls, auto theme matching, and numerous bug fixes.

OpenClawRadar