Microsoft’s voice that sounds like it came from a human
Microsoft AI launched their MAI-Transcribe-2-Streaming Speech Recognition model which can recognize 60 languages with low latency (~100 ms) and their MAI-Voice speech synthesis models (MAI-Voice-2.1 + Flash).
Lately, I’ve been pondering about speech recognition technologies. In particular, I was thinking about voice agents with very low latency requirements for good usability. Recently, Microsoft AI published their speech recognition model, MAI-Transcribe-2-Streaming, which supports 60 languages and provides first results after ~100 ms. According to them, they are the best at Artificial Analysis. They also released new speech synthesis models, MAI-Voice-2.1 and a faster version, Flash. Both models support 23 languages with one voice and have a natural accent. They can clone any voice within a couple of seconds based on a short audio recording. For 4,000 participants, almost half believed that the synthetic voice was human. Flash is available for $15/million characters, whereas the normal version is $22/million characters.
With such low latency (100–150 ms), you can build a voice assistant that either appears to listen actively or interrupts the conversation. Exactly what Microsoft intends to do with their product: having agents react while the user is talking. Half of the participants couldn’t distinguish between synthetic and human voices. This will be sufficient for cold calling or an answering machine. The difference in price between Flash and the normal version quickly accumulates if your agent needs to handle many conversations. You can integrate this solution with your current system using OpenRouter or MAI Playground, but then you need yet another paid API key. I recommend trying it out with a subset of your conversations before deploying it.
Source: the-decoder.com
Free course
Stop reading about AI — start building with it
The free Claude Code course: your first site, tool or game — no coding. No upsells, no cross-sells — nothing to buy here.
Start free →
Author
Evgenii Arsentev
PhD · Founder & CEO, Dad4Kids
Articles · Latest articles