比特币橙子Trader|8月 29, 2026 01:24
Holy crap, this open-source repo is pretty cool—an Agent that automatically edits videos!
Someone actually turned coding Agents like Codex and Claude Code into professional video editors.
You just throw a bunch of raw footage at it and say something like:
'Edit this footage into a 60-second short video, find the most exciting clips, add subtitles, and make a catchy intro animation.'
It will watch the video, listen to the audio, read the transcript, find the timestamps, and actually edit the timeline for you.
This project is called Diffusion Studio.
The biggest advantage, in my opinion, is that it gives Codex, Claude Code, Cursor, and Gemini CLI the ability to edit videos directly.
In the past, if you wanted an Agent to help you edit videos, the biggest problem was that it couldn’t even understand your raw footage. You’d have to extract frames, transcribe, analyze, write scripts, call FFmpeg, and even then, the output was hard to tweak manually.
Diffusion Studio gives Agents a dedicated set of video tools:
It can analyze keyframes, generate film previews, analyze audio waveforms, transcribe word-for-word, understand what’s being said in a specific time segment, and even directly control the canvas and timeline.
What’s even cooler is that after the Agent makes edits, you can continue tweaking the timeline, subtitles, and animations in the editor; once you’re done, the Agent can pick up where you left off.
This is because the backend turns the video project into code—any changes you make to the canvas sync to the code, and any code edits re-render on the canvas.
This, to me, is the direction AI video editing should really be heading:
It’s not about creating another black box that generates videos from a single command, but about integrating Agents into workflows like Premiere or Jianying, making them editors that can understand footage, make edits, and collaborate with humans.
Right now, it can already handle long video edits, short video clips, subtitles, animations, promos, content analysis, and even generate images, videos, and voiceovers.
Just install the desktop app, and add a Skill to Codex/Claude Code to get started:
`npx skills add diffusionstudio/skills`
The project was only created in July, and in less than two months, it’s already close to 1,000 Stars. Plus, they’ve been rolling out major updates throughout August.
Share To
HotFlash
APP
X
Telegram
CopyLink