#259259th of 324 in Skills, plugins and prompts
claude-video-vision
Claude Code plugin that lets Claude watch videos via ffmpeg frames and transcripts
- Stars
- 1.4k
- License
- MIT
- Last commit
- Oct 2026
- Last release
- Oct 2026
- Language
- TypeScript
2 on 3 Apr 20261,446 on 30 Oct 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
An MCP server and Claude Code plugin that extracts video frames with ffmpeg and sends them to Claude as base64 images with timestamps, alongside an audio transcription. Audio comes from the Gemini API, local Whisper (whisper.cpp or Python openai-whisper), or the OpenAI Whisper API. It also accepts YouTube URLs via yt-dlp, using manual or automatic captions before falling back to the audio backend.
Who it is for: Claude Code users who want Claude to analyze local or YouTube videos
Strengths
- Three audio backends, including fully offline whisper.cpp with automatic model download
- YouTube URLs use manual or auto captions first, with transcription_source labeled
- Six MCP tools, including video_analyze and video_detail for drilling into specific moments
- Frame fps, time range, resolution and format (jpeg, png, webp) are adjustable
Weaknesses
- Requires Node.js 24+ and ffmpeg installed locally
- YouTube support needs yt-dlp installed separately
- Only a perception layer: no interpretation, and frames count against Claude's context
- Windows users may need a global npm install workaround if npx fails
What it needs
- GPU optional
- Needs Node.js 24+, ffmpeg, yt-dlp (optional, YouTube), whisper.cpp or openai-whisper (local backend), Gemini API key or OpenAI API key (cloud backends)
- Models: Gemini API, whisper.cpp, openai-whisper, OpenAI Whisper API
Quick answers
Is claude-video-vision open source?
Yes. Its code is on GitHub under the MIT license.
Also in Skills, plugins and prompts
See all 324| Rank | Project | Score |
|---|---|---|
| 1 | impeccableDesign skill with 24 slash commands for AI coding agents' frontend output | 96 out of 100 |
| 2 | skillsAgent skills for planning, TDD, debugging and code review | 95 out of 100 |
| 3 | eccAgents, skills, hooks and rules bundle for Claude Code, Codex and other harnesses | 95 out of 100 |
| #4 | gstackMarkdown slash-command skills that give Claude Code planning, review, QA and ship roles | 95 out of 100 |
| #5 | cavemanCuts token use in coding agents with terse replies and compressed inputs | 95 out of 100 |