storyboard-tts
Converts storyboard markdown (bilingual Chinese + English narration per shot) into speech audio via IndexTTS2 (same stack as ai-text-to-speech). Batch-writes WAVs under Chinese/ and English/ named by shot id (model loaded once), pads 0.4 s edge silence in place, then a speech-timeline.md and one concatenated SRT per language (Chinese.srt / English.srt). Use when the user wants storyboard TTS, storyboard to speech, narration VO, storyboard-to-speech, bilingual VO export, subtitles, or batch TTS from a storyboard.md.
godot-fun · Static checks on file
Installation
Read the source and dependencies before running a command. Copying does not install or execute anything.
npx skills add godot-fun/godot-agent --skill storyboard-ttsAbout this skill
name: storyboard-tts description: >- Converts storyboard markdown (bilingual Chinese + English narration per shot) into speech audio via IndexTTS2 (same stack as ai-text-to-speech). Batch-writes WAVs under Chinese/ and English/ named by shot id (model loaded once), pads 0.4 s edge silence in place, then a speech-timeline.md and one concatenated SRT per language (Chinese.srt / English.srt). Use when the user wants storyboard TTS, storyboard to speech, narration VO, storyboard-to-speech, bilingual VO export, subtitles, or batch TTS from a storyboard.md.
Storyboard TTS
Take a storyboard deliverable and batch-synthesize Chinese + English voice-over with IndexTTS2 (shared setup with ai-text-to-speech).
| Output | Path |
|---|---|
| Chinese VO | <storyboard-dir>/<voice-stem>/Chinese/<shot-id>.wav |
| English VO | <storyboard-dir>/<voice-stem>/English/<shot-id>.wav |
| Duration doc | <storyboard-dir>/<voice-stem>/speech-timeline.md |
| Chinese subs | <storyboard-dir>/<voice-stem>/Chinese.srt |
| English subs | <storyboard-dir>/<voice-stem>/English.srt |
Shot id from headers (### Shot 01 — … → 01.wav).
Subtitles: one SRT per language. Shots are laid end-to-end on the VO timeline (shot N starts when N−1 ends). Inside a shot, text is split on sentence punctuation (.!?;… and CJK equivalents) into multiple cues; cue lengths share that shot’s WAV duration by non-whitespace character weight. Skip (no VO) / missing audio.
Rules
When this skill applies, read and follow skill-dependency-manager — run scripts as documented, install missing tools into .dependency/.
- Batch synthesis only via
.ai/storyboard-tts/synthesize.pywith theindex-ttsinterpreter. Do not hand-write IndexTTS loops, temporary batch drivers, or N× singletts.pycalls for a full storyboard. - Trial / single-line checks may use ai-text-to-speech
tts.py, orsynthesize.py --limit 1. - Parse-only / report-only / subtitle-only steps use stdlib
python(.dependency/python/python). - Never overwrite the storyboard source. Write only under
<audio-dir>/. - Skip
(no VO)/ empty lines — no empty WAVs or empty subtitle cues. - Confirm voice reference (and output dir if unclear) before a full batch.
- The top-level output directory uses the reference voice filename stem. Subdirectory names stay fixed. Default
<audio-dir>is<storyboard-dir>/<voice-stem>/. Do not use<storyboard-stem>-speech.
Inputs
| Required | Notes |
|---|---|
Storyboard .md | ### Shot NN — title with - **Chinese:** / - **English:** |
| Reference voice | WAV/MP3 for IndexTTS (--voice, or --voice-zh / --voice-en) |
| Optional | Default |
|---|---|
| Output dir | <storyboard-dir>/<voice-stem>/ (reference audio filename, no extension) |
| Language | both (--lang chinese / english) |
--fp16 / emotion / --device | same meaning as ai-text-to-speech |
--force | off (skip existing WAVs) |
--limit N | 0 = all jobs (use 1 for trial) |
--report | write speech-timeline.md + Chinese.srt / English.srt after synth |
--no-subtitles | with --report, skip SRT files |
| Edge pad | on (0.4 s); --no-pad / --pad-duration / --pad-threshold |
Layout
<storyboard-dir>/<voice-stem>/ # e.g. narrator-self-fast/ from narrator-self-fast.wav
Chinese/
01.wav
…
English/
01.wav
…
shots.json
speech-timeline.md
Chinese.srt # all Chinese cues, continuous timeline
English.srt # all English cues, continuous timeline
_text/ # only with --write-text
Quick Start
From project root:
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --fp16 --report
Trial run (first line only):
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --fp16 --limit 1
Writes under <storyboard-dir>/<voice-stem>/ (override with --audio-dir only when needed).
This will:
- Parse the storyboard →
<audio-dir>/shots.json - Load IndexTTS2 once
- Write
Chinese/<id>.wavandEnglish/<id>.wav(skip existing unless--force) - Pad each WAV in place to 0.4 s leading/trailing silence (
--no-padto skip) - Write
speech-timeline.mdandChinese.srt/English.srtwhen--report
Separate voices / language
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice-zh path/to/zh_ref.wav --voice-en path/to/en_ref.wav --fp16 --report
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --storyboard path/to/storyboard.md --voice path/to/ref.wav --lang chinese --fp16 --report
Parse, report, or subtitles alone (stdlib python)
.dependency/python/python .ai/storyboard-tts/parse_storyboard.py path/to/storyboard.md -o path/to/<audio-dir>/shots.json
.dependency/python/python .ai/storyboard-tts/duration_report.py --storyboard path/to/storyboard.md --audio-dir path/to/<audio-dir> --shots path/to/<audio-dir>/shots.json -o path/to/<audio-dir>/speech-timeline.md
.dependency/python/python .ai/storyboard-tts/write_subtitles.py --audio-dir path/to/<audio-dir> --shots path/to/<audio-dir>/shots.json
Resume from an existing shots.json:
.dependency/index-tts/.venv/Scripts/python.exe .ai/storyboard-tts/synthesize.py --shots path/to/<audio-dir>/shots.json --voice path/to/ref.wav --fp16 --report
Common Flags (synthesize.py)
| Flag | Notes |
|---|---|
--storyboard / --shots | Source (one required) |
--audio-dir | Output r |