Skip to content

Voice in Production

Streaming TTS & the Latency Budget

9 min+80 XPStep 1/10

Users hear latency, not quality

The metric that defines streaming TTS isn't audio fidelity — it's TTFB: time to first byte (or first audible sample). A system that synthesizes the full utterance then plays is dead for agents: the user waits through the entire generation while silence says 'broken'.

The mental model: conversational response time needs to land under ~1 second; TTS TTFB is the tail of that budget, after ASR and the LLM. Perfect audio delivered at 1.8s loses to good audio delivered at 250ms — humans forgive texture, they don't forgive dead air.

insight

Streaming TTS quality is measured at the ear of an impatient human: TTFB for the feel, then sustained throughput to keep playback ahead of the speaker.