๐ ChloeOS YTVoice: Cloud-Hosted Concatenative TTS Playhead Database
This video contains the concatenative playhead database for the ChloeVoice speech synthesizer, consisting of 13,126 raw voice sprites stitched together. Each word is separated by a 250ms silence guard band to prevent audio bleeding during playhead seeks.
By utilizing the companion subtitle (.srt) track, any system with internet access can use this video as a remotely hosted voice synthesizerโallowing low-resource devices to speak arbitrary sentences with 0% local audio storage constraints!
Inspired by how the Autobot Bumblebee speaksโscanning radio frequencies and stitching recorded voice fragments together on-the-flyโYTVoice treats this video as a remote soundboard.
—————————————————————-
๐ ๏ธ HOW TO USE: PLAYHEAD ARCHITECTURE
—————————————————————-
1. Load the SRT Map: Parse the companion .srt subtitle file into a light index mapping each word to its start timestamp and duration (in milliseconds).
2. Seek and Play: Use an on-the-fly slice tool to jump directly to a word’s start timestamp, play for its specific duration, and pause.
3. Sequence: Chain seeks together to stitch words dynamically on-the-fly.
—————————————————————-
โ ๏ธ SYSTEM COMPATIBILITY NOTICE
—————————————————————-
โ
COMPATIBLE WITH: Linux (Ubuntu/Debian), macOS, Windows, Raspberry Pi, and Android Termux.
โ NOT NATIVELY COMPATIBLE WITH: Standalone microcontrollers (ESP32, ESP8266, Arduino) due to full Python framework, FFmpeg, and yt-dlp dependencies.
—————————————————————-
๐ฆ PREREQUISITES
—————————————————————-
Core Binaries Needed in System PATH:
โข ffmpeg (For rapid millisecond audio slice extractions)
โข mpv or ffplay (For automatic hardware media playback)
Python Ecosystem:
โข pydub = 0.25.1
โข yt-dlp = 2023.01.01
โข soundfile numpy (Required only for offline binary compiler mode)
โข audioop-lts (Conditional backport required for Python 3.13+)
—————————————————————-
๐ CORE MODES OF OPERATION (Via Client Repository)
—————————————————————-
1๏ธโฃ YouTube Cloud Mode: Bypasses local storage. Resolves this video stream using HTTP range requests to download only the precise word fractions needed on-the-fly.
๐ python3 src/player.py “your sentence text here” –youtube r-WQt6Hi86Y
2๏ธโฃ Local Offline Mode: Slices a local media container file on disk instead of loading it entirely into RAM, keeping the memory footprint under 15MB.
๐ python3 src/player.py “your sentence text here” –audio database_speech.mp4
3๏ธโฃ Compiled Binary Mode: Direct disk byte seeks against an uncompressed flat raw package with 0ms seek latency.
๐ python3 src/player.py “your sentence text here” –bin voice_sprites.bin –index voice_sprites.bin.index.json
—————————————————————-
๐ SOURCE CODE
—————————————————————-
GitHub Repository: https://github.com/acadiemedia/ytvoice
Note: This project is an open-source project released under the MIT License. It is currently built as a proof-of-concept prototype.
#Python #TextToSpeech #FFmpeg #Ytdlp #Termux #OpenSource #RaspberryPi #Hacking #Transformers
source
