Core
Speech and Voice AI
A voice agent chains automatic speech recognition (ASR) to transcribe audio, an LLM to decide the reply, and text-to-speech (TTS) to speak it, with voice activity detection and barge-in handling the turn-taking. Hitting a sub-second feel depends on streaming every stage and starting speech before the LLM finishes. FDE loops probe this because the latency budget across stages, and when to abandon the cascade for end-to-end speech-to-speech, is where voice deployments live or die.
a free account unlocks the core curriculum tier · no card
Related concepts
Practise this in questions
System Design & Production EngineeringBuild a voice-to-voice agent (ASR to LLM to TTS) that feels natural at under 500ms end to end. Break down the latency budget. →hard · PremiumLLM & GenAI FundamentalsYour voice agent talks over callers and mishears account numbers, yet word error rate is 6%. Diagnose both, and say what to measure instead. →hard · PremiumLLM & GenAI FundamentalsDesign the eval for a voice agent taking inbound support calls. What do you measure offline, and what can only production tell you? →hard · Premium