Skip to content
OpenAgentSkill
Browsing is open · Catalog captured 2026-11-21 · Automatic updates and account services are paused.
Video & audio

storyboard-tts

Converts storyboard markdown (bilingual Chinese + English narration per shot) into speech audio via IndexTTS2 (same stack as ai-text-to-speech). Batch-writes WAVs under Chinese/ and English/ named by shot id (model loaded once), pads 0.4 s edge silence in place, then a speech-timeline.md and one concatenated SRT per language (Chinese.srt / English.srt). Use when the user wants storyboard TTS, storyboard to speech, narration VO, storyboard-to-speech, bilingual VO export, subtitles, or batch TTS from a storyboard.md.

godot-fun · Static checks on file

Installation

Read the source and dependencies before running a command. Copying does not install or execute anything.

npx skills add godot-fun/godot-agent --skill storyboard-tts

About this skill


name: storyboard-tts description: >- Converts storyboard markdown (bilingual Chinese + English narration per shot) into speech audio via IndexTTS2 (same stack as ai-text-to-speech). Batch-writes WAVs under Chinese/ and English/ named by shot id (model loaded once), pads 0.4 s edge silence in place, then a speech-timeline.md and one concatenated SRT per language (Chinese.srt / English.srt). Use when the user wants storyboard TTS, storyboard to speech, narration VO, storyboard-to-speech, bilingual VO export, subtitles, or batch TTS from a storyboard.md.

Storyboard TTS

Take a storyboard deliverable and batch-synthesize Chinese + English voice-over with IndexTTS2 (shared setup with ai-text-to-speech).

OutputPath
Chinese VO<storyboard-dir>/<voice-stem>/Chinese/<shot-id>.wav
English VO<storyboard-dir>/<voice-stem>/English/<shot-id>.wav
Duration doc<storyboard-dir>/<voice-stem>/speech-timeline.md
Chinese subs<storyboard-dir>/<voice-stem>/Chinese.srt
English subs<storyboard-dir>/<voice-stem>/English.srt

Shot id from headers (### Shot 01 — … → 01.wav).

Subtitles: one SRT per language. Shots are laid end-to-end on the VO timeline (shot N starts when N−1 ends). Inside a shot, text is split on sentence punctuation (.!?;… and CJK equivalents) into multiple cues; cue lengths share that shot’s WAV duration by non-whitespace character weight. Skip (no VO) / missing audio.

Rules

When this skill applies, read and follow skill-dependency-manager — run scripts as documented, install missing tools into .dependency/.

  1. Batch synthesis only via .ai/storyboard-tts/synthesize.py with the index-tts interpreter. Do not hand-write IndexTTS loops, temporary batch drivers, or N× single tts.py calls for a full storyboard.
  2. Trial / single-line checks may use ai-text-to-speech tts.py, or synthesize.py --limit 1.
  3. Parse-only / report-only / subtitle-only steps use stdlib python (.dependency/python/python).
  4. Never overwrite the storyboard source. Write only under <audio-dir>/.
  5. Skip (no VO) / empty lines — no empty WAVs or empty subtitle cues.
  6. Confirm voice reference (and output dir if unclear) before a full batch.
  7. The top-level output directory uses the reference voice filename stem. Subdirectory names stay fixed. Default <audio-dir> is <storyboard-dir>/<voice-stem>/. Do not use <storyboard-stem>-speech.

Inputs

RequiredNotes
Storyboard .md### Shot NN — title with - **Chinese:** / - **English:**
Reference voiceWAV/MP3 for IndexTTS (--voice, or --voice-zh / --voice-en)
OptionalDefault
Output dir<storyboard-dir>/<voice-stem>/ (reference audio filename, no extension)
Languageboth (--lang chinese / english)
--fp16 / emotion / --devicesame meaning as ai-text-to-speech
--forceoff (skip existing WAVs)
--limit N0 = all jobs (use 1 for trial)
--reportwrite speech-timeline.md + Chinese.srt / English.srt after synth
--no-subtitleswith --report, skip SRT files
Edge padon (0.4 s); --no-pad / --pad-duration / --pad-threshold

Layout

<storyboard-dir>/<voice-stem>/   # e.g. narrator-self-fast/ from narrator-self-fast.wav
  Chinese/
    01.wav
    …
  English/
    01.wav
    …
  shots.json
  speech-timeline.md
  Chinese.srt            # all Chinese cues, continuous timeline
  English.srt            # all English cues, continuous timeline
  _text/                 # only with --write-text

Quick Start

From project root:

.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --fp16 --report

Trial run (first line only):

.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --fp16 --limit 1

Writes under <storyboard-dir>/<voice-stem>/ (override with --audio-dir only when needed).

This will:

  1. Parse the storyboard → <audio-dir>/shots.json
  2. Load IndexTTS2 once
  3. Write Chinese/<id>.wav and English/<id>.wav (skip existing unless --force)
  4. Pad each WAV in place to 0.4 s leading/trailing silence (--no-pad to skip)
  5. Write speech-timeline.md and Chinese.srt / English.srt when --report

Separate voices / language

.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice-zh path/to/zh_ref.wav --voice-en path/to/en_ref.wav --fp16 --report
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --lang chinese --fp16 --report

Parse, report, or subtitles alone (stdlib python)

.dependency/python/python .ai/storyboard-tts/parse_storyboard.py path/to/storyboard.md -o path/to/<audio-dir>/shots.json
.dependency/python/python .ai/storyboard-tts/duration_report.py --storyboard path/to/storyboard.md --audio-dir path/to/<audio-dir> --shots path/to/<audio-dir>/shots.json -o path/to/<audio-dir>/speech-timeline.md
.dependency/python/python .ai/storyboard-tts/write_subtitles.py --audio-dir path/to/<audio-dir> --shots path/to/<audio-dir>/shots.json

Resume from an existing shots.json:

.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --shots path/to/<audio-dir>/shots.json --voice path/to/ref.wav --fp16 --report

Common Flags (synthesize.py)

FlagNotes
--storyboard / --shotsSource (one required)
--audio-dirOutput r
Read the complete source ↗