storyboard-av-mix
Muxes per-shot storyboard video with Chinese and English voice-over by retiming video to match VO duration (setpts), writing Video-Chinese/ and Video-English/ (matched by shot id 01, 02, …). Use when the user wants storyboard A/V mix, storyboard A/V mix, VO dubbing mix, video retime to audio, Video-Chinese, Video-English, bilingual VO on cut video, or batch mux Video/ + Chinese/ + English/.
godot-fun · 已有静态检查记录
安装与使用
运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。
npx skills add godot-fun/godot-agent --skill storyboard-av-mix技能说明
name: storyboard-av-mix description: >- Muxes per-shot storyboard video with Chinese and English voice-over by retiming video to match VO duration (setpts), writing Video-Chinese/ and Video-English/ (matched by shot id 01, 02, …). Use when the user wants storyboard A/V mix, storyboard A/V mix, VO dubbing mix, video retime to audio, Video-Chinese, Video-English, bilingual VO on cut video, or batch mux Video/ + Chinese/ + English/.
Storyboard AV Mix
Take a work directory with per-shot video and bilingual VO. For each shot, retime the video to the full VO duration (audio master), drop original video audio, mux, and write language-specific folders.
| Input | Path |
|---|---|
| Shot video | <root>/Video/<shot-id>.* |
| Chinese VO | <root>/Chinese/<shot-id>.* |
| English VO | <root>/English/<shot-id>.* |
| Output | Path |
|---|---|
| Chinese mux | <root>/Video-Chinese/<shot-id>.<video-ext> |
| English mux | <root>/Video-English/<shot-id>.<video-ext> |
Rules
When this skill applies, read and follow skill-dependency-manager — run scripts as documented, install missing tools into .dependency/.
- VO timing is immutable. Never stretch, shrink, pad, trim, or
atempothe voice-over. Duration of the VO file is the master clock. - Video serves audio. Only change video duration (FFmpeg
setpts) so it equals that shot’s VO length, then mux. - Drop all audio from the source video; replace with the VO track. Prefer
-c:a copy; if the container cannot hold the VO codec (e.g. WAV→MP4), encode AAC without changing length. - Do not downgrade video.
setptsrequires a re-encode, but match the source: codec family (H.265 Main10 when source is 10-bit HEVC),pix_fmt, bitrate, color tags, and HDR side data (mastering display / MaxCLL). Copy container + video-stream metadata from the source clip. - Match shots by filename stem (
01.mp4↔01.wav). - Batch only via
.ai/storyboard-av-mix/mix.py— do not hand-write FFmpeg mux/retime commands. - Never overwrite inputs under
Video/,Chinese/, orEnglish/.
Quick Start
From project root:
.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root>
Single language:
.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root> --lang chinese
Per shot / language the script:
- Probes VO duration (source of truth) and video duration
- Applies
setpts=PTS*(vo_dur/video_dur)— stretch or compress video only (plus short freeze-tail so video ≥ VO) - Muxes with
-shortestso container duration == VO duration - Writes
<root>/Video-Chinese|orVideo-English//<shot-id>.<same-ext>
Layout
<root>/
Video/
01.mp4
02.mp4
Chinese/
01.wav
02.wav
English/
01.wav
02.wav
Video-Chinese/ # written by this skill
01.mp4
02.mp4
Video-English/
01.mp4
02.mp4
Typical <root> is a storyboard-tts audio dir that also has a sibling or nested Video/ of cut clips — confirm the folder that contains Video/, Chinese/, and English/.
Common Flags
| Flag | Notes |
|---|---|
root | Work dir with Video/, Chinese/, English/ |
--lang | both (default), chinese, english |
Existing outputs are overwritten. Missing VO for a language → skip that job with a warning. Missing video → skip shot.
Agent Notes
- Audio first: if durations disagree, change video, never VO.
- Prefer one
mix.pyrun for the whole board. - Re-encode must preserve source quality tags (Main10 / HDR / bitrate) — never force 8-bit H.264.
- Chat summary:
<root>, jobs done / skipped, paths toVideo-Chinese/andVideo-English/. - Upstream VO usually from storyboard-tts; this skill does not synthesize speech.
- Missing Python/FFmpeg → populate
.dependency/per skill-dependency-manager, retry same command.
Tests
From repo root:
.dependency/python/python .ai/storyboard-av-mix/test_mix.py
Related
- storyboard-tts — bilingual VO under
Chinese//English/ - storyboard — source markdown
Manual CLI examples: cli/storyboard-av-mix.md