vaweGitHub

Agentic video editing: your coding agent cuts your clips.

Agentic video editing is editing where an AI agent makes the cuts: it reads the footage, chooses the order, the trims and the timing, and renders the result. In vawe, a coding agent such as Claude Code, Codex or Cursor reads your clips as text, writes the edit as one HTML page, and vawe renders it frame by frame to an MP4 on your machine.

How an edit runs: five steps from a folder to an MP4.

  1. Hand over the clips. bin/vawe new trip-edit --footage ~/Movies/trip copies them into the film’s folder.
  2. Log them. vawe writes footage.md: each clip’s length, shots, loudness, a contact sheet and a transcript. A words file beside it gives every word its start and end time.
  3. Plan the cut. The agent fills a Cut list: one row per beat with the clip, the in and out seconds, the speed and the reason.
  4. Write one page. Each clip is a <video> inside its beat. data-at, data-trim and data-rate say which second shows when, and the engine seeks it every frame.
  5. Render. bin/vawe dev renders a half-size draft with sound. The final render waits for your OK.
prompts/edit-from-clips.md · skills/vawe-page/SKILL.md, Video clips

An agent cannot watch video, so it reads it.

A model that looked at every frame would spend its budget on noise. footage.md and the words file beside each clip give it the facts it can act on: where the shots change, how loud each clip is, and which word is spoken at which second. The agent cuts on a word end or an action, never on a guess from a file name.

The transcripts come from whisper.cpp on your machine, so there is no API key and no upload. Install it once with brew install whisper-cpp and a 148 MB model; the first footage log prints the download line if the model is missing.

harness/media/footage.mjs

What it can and cannot do.

Your clips are content, moved whole. An agent edit can:

  1. Trim, order and change the speed of each clip.
  2. Cut the silences in speech and keep every word whole.
  3. Add title cards, lower thirds and word-timed captions.
  4. Grade the colour and add transitions between clips.
  5. Mix music from a file you give, with speech ducking it.

It does not process the picture inside a clip: no tracking, no rotoscoping, no depth cuts and no generated video. An edit is usually 8 to 60 seconds, 16:9 by default, and a clip is never cropped to fit another aspect.

guides/ROUTING.md, edit scope

The video components an edit uses most.

Captions for a muted viewer, a name on screen, a soft change between clips and a fast one. Open a video component for its snippet and notes.

More on editing with an agent.

  1. Edit video with Claude Code: the steps in Claude Code, Codex or Cursor, and the questions the agent asks first.
  2. Edit video with code: ffmpeg, MoviePy, Editly, Remotion and vawe compared, with sources.
  3. Turn a screen recording into a demo video: trim the dead time, speed up the waits, add titles and captions.
  4. vawe vs video-use: another open-source way to edit clips with a coding agent, and when it is the better choice.
  5. vawe vs OpenEdit: an open-source pipeline from VEED that also lets an agent edit clips, and how it differs.
  6. How an agent reads footage it cannot watch: what footage.md holds and why the agent cuts on a word end.
  7. Cut the silences with an agent: trim the pauses and keep every word whole.
  8. Captions on a video, in HTML: word-timed captions, the part of an edit a muted viewer reads.
  9. Aspect ratios without cropping: one edit at 16:9, 9:16, 1:1 or 4:5.

Start an edit from your clips.

bin/vawe new <name> --footage <folder> logs the clips, writes the Cut list and a starter page, then asks the details the edit needs, each with a default.