Real-time speech-to-speech translation
Hearing speech in one language and delivering it in another, in the listener's ear or the speaker's voice, fast enough for natural face-to-face conversation.
State of the art
Apple AirPods Live Translation and Google Meet speech translation (2025); Google Translate live speech on any headphones for 70+ languages (Dec 2025).
- 2–3 s latency, versus near-zero for the fictional device, from waiting for verb and context
- Quality collapses for low-resource languages, dialects and noisy multi-speaker settings
Who’s working on it
- Apple ↗Company
AirPods Live Translation (2025) delivers in-ear speech-to-speech across 11 languages with on-device inference, the first mass-market deployment
- GoogleCompany
Meet speech translation (2025) renders the speaker's translated voice in near real time at consumer scale, and Translate's live modes cover the high-resource set
- DeepL ↗Company
Launched Voice-to-Voice in April 2026 covering 40+ languages for live meetings and an API, the broadest language coverage of any shipping real-time product
- Palabra AI ↗Startup
Raised $8.4M pre-seed led by Seven Seven Six in August 2025 for sub-800ms speech-to-speech preserving the speaker's voice across 30+ languages
- Meta AI ↗Company
SeamlessM4T and Seamless expressive streaming (2023) are the open research baseline for simultaneous, prosody-preserving translation that commercial systems build on
- Alexander WaibelResearcherCarnegie Mellon University and Karlsruhe Institute of Technology
Pioneered simultaneous speech translation and the long-running lecture-translator deployments that defined the latency targets the field now hits
What to invest in
| Kind | Investment | Scale |
|---|---|---|
| research | Simultaneous translation models that predict sentence structure to cut latency below 1 s | $$ $10M – $100M |
Depends on
Required by
No other capability builds on this directly.