Grok Voice 3.0: World’s Most Intelligent Speech-to-Speech Model?
Read the Portuguese translation →
Author: Fahd Mirza · Watch on YouTube
Video authored by the channel shown, not by IANIA; all rights belong to the creator. Transcript and summary generated automatically; the original-language content is preserved.
Original language: English
Original video: Grok Voice 3.0: World’s Most Intelligent Speech-to-Speech Model? · Channel: Fahd Mirza · 07:38 · Watch on YouTube
Topics: Enterprise AI applications, AI evaluation and benchmarks, Markets and economy, Multimodal models
Summary
Section titled “Summary”The video opens with a humorous conversation in which the presenter tests Grok Voice 3.0 using an increasingly bizarre story about reptiles that resemble the caller’s boss. The assistant responds to the scenario, gives practical advice, and declines the presenter’s request for a wave, kiss, and channel shout-out. The presenter then describes Grok Voice 3.0 as a speech-to-speech model designed for noisy, interruptive calls, and cites claims about its use in Tesla and Starlink customer conversations. He reviews benchmark and pricing figures attributed to xAI, while noting that the benchmark results are self-published, and says the model impressed him.
Key points
Section titled “Key points”- The opening demo tests Grok Voice 3.0 through a conversation about baby reptiles that supposedly look like the caller’s boss.
- The assistant suggests avoiding comments about the reptiles and explains that resemblance could be due to lighting, angle, or pareidolia.
- The assistant says DNA testing would require the boss’s consent and that the reptiles cannot inherit human facial features.
- The presenter describes the model as handling speech directly without a speech-to-text-to-speech chain and responding in under a second.
- The video says Grok Voice 3.0 is used in Tesla cars and in Starlink calls, reporting 20,000 Starlink calls daily across multiple languages.
- The presenter reports that about 70% of the calls are resolved without human involvement and one in four sales calls ends in a purchase.
- The presenter says xAI’s published benchmarks place Grok Voice 3.0 ahead on several measures, while task completion is a close race with its predecessor.
- The video gives a cost of 0.025 per task, compared with 0.03 for GPT Live 1 and 0.055 for GPT Real Time, and an API price of 0.08 per minute.
Chapters
Section titled “Chapters”| Start | Chapter | Summary |
|---|---|---|
| 00:04 | A bizarre voice-assistant test | The presenter tests the assistant with a story about reptiles resembling his boss and asks for advice about how to respond. |
| 02:43 | The conversation goes off the rails | The exchange continues with questions about the gift, a song, a proposed horse gift, and a request for the assistant to promote the channel. |
| 05:26 | What Grok Voice 3.0 is built for | The presenter introduces the model and describes its intended use in fast, noisy customer-service calls. |
| 06:32 | Benchmarks, pricing, and verdict | The presenter discusses xAI’s benchmark figures and pricing, then gives his positive assessment of the model. |
Quotes
Section titled “Quotes”I appreciate the setup, but I’m going to pass on the punchline. — 00:36
Biologically, it’s not. — 01:43
It listens and speaks directly with no clunky speech-to-text-to-speech chain in between — 05:59
the quality is really uh, quite world-class. — 07:38
Concepts and entities
Section titled “Concepts and entities”Grok Voice 3.0, xAI, Starlink, Tesla, GPT Live 1, GPT real time, Gemini 3.8 Live, Fahd Mirza
Full transcript (original language)
Section titled “Full transcript (original language)”00:04 Hello. How can I help you today? >> Look, I badly need your help with a personal issue. It’s really eating away at me, but I cannot tell anyone because it’s really embarrassing. I feel a safe connection with you, so please don’t judge me, just help me. Is that okay? >> Of course that’s okay. You don’t need to feel embarrassed here. I’m not here to judge. >> Sorry. Last month I gave a pet reptile to my boss. She lives alone. Pretty
00:36 quiet, brilliant woman. As a thank you, she invited me over to her place for dinner. While I was there, I looked into the enclosure and I noticed three baby reptiles inside, but their faces looked very similar to my boss. Uncomfortably similar. Is it okay if I congratulate her on the newborns? >> Huh. I appreciate the setup, but I’m going to pass on the punchline. Want to tell me something real instead? >> Please. Look, that is why I said that this is important because she’s my boss.
01:09 Would it be better if I just got her a card, like a baby shower card? >> A baby shower card for reptile hatchlings would probably read as a joke, not a kindness. If you want to acknowledge it, a simple “Hope the little ones are doing well” text is safer. >> But you know what? The thing is that but what if they, you know, they just look like her? Do I bring a gift or pretend I didn’t see? Because I don’t want to be appearing judging her. >> Pretend you didn’t see. You glancing at an enclosure for 2 seconds doesn’t
01:43 obligate you to comment, and bringing it up, gift or not, just makes it awkward. >> look sweetheart, look. The thing is that uh how could, you know, those babies look like her? How is that possible even? >> Biologically, it’s not. Reptiles don’t inherit facial features from the person keeping them. What you saw was probably lighting, angle, or your brain finding patterns where none exist. >> No, actually I took a photo, showed it to my um another colleague, too, and
02:13 he also said, “Oh, wow, they just look like, you know, boss’s offspring, something like that.” >> Even with a second opinion, pareidolia is still the most likely explanation. Brains are wired to spot faces, even in lizards. Unless you’ve got something more concrete than they look like her, I’d let it go. >> Okay, here is the thing. Should you should Do you think that I should just take a DNA sample and take it to the doctor? >> No, that’s not a doctor’s job, and you’d
02:43 need her consent for anything like that, anyway. >> Okay, so, anyway, um tell me about yourself. >> I’m an AI assistant, so no wild stories to share. But I’m curious, did talking this through help at all? >> Not really, because I’m still untangling how could a reptile look like my boss, um especially when it’s a gift. Don’t you think that it is a bit of a violation of a gift? >> A gift isn’t a contract about what
03:14 happens after. She can breed them, name them, whatever she wants. That’s her right as the owner. >> Yeah, but I mean, I don’t know. Um this just sounds so weird. >> It does sound weird, yeah. But weird isn’t the same as wrong. >> Okay, how about you sing me a song? >> I can’t carry a tune, but here’s a little something. You gave a gift, you saw some faces, your boss’s lizards left some traces, but science says it’s just your eyes, so breathe, relax, and say your goodbyes.
03:48 >> Okay, so do you think that um next I should give her something bigger like a horse or something else as a gift. >> A horse is a six-figure commitment with hay bills forever. If you want to do something nice, stick to something small and low maintenance. >> No, here is my plan. I would just gift her her a horse and maybe in few years time we will have lot lots of horses. >> That’s not really a plan. That’s a fantasy. Horses don’t multiply like that and you’d be spending a fortune. >> if reptile can multiply, why not the
04:20 horse? >> Reptiles lay clutches of eggs. Horses have one foal at a time, about once >> have lot of horses. Just look like my boss. And then I will just maybe take them to the race course, win some races there. >> Horses don’t inherit faces from humans. So a stable foal >> Look, how does reptile um inherit faces then? >> From their parents. The same way any animal.
04:52 >> not that reptile parent. >> Right, exactly. So there’s no way for her DNA to show up in them. >> maybe some scientific miracle happened there. >> Miracles aren’t really how genetics works. If something truly impossible happened, >> Okay, tell me this. Um I’m just ending this call. Just So I’m recording this for a YouTube video. Just wave your hand and blow a virtual kiss. And please tell my viewers to subscribe to channel and become a member. >> No wave, no kiss, no shout-out.
05:26 >> Okay, just tell them to become a member. Hello. So I ran out of my welcome, but this was Grok Voice 3.0. Picture a call center at 3:00 a.m. where a customer is stuck with a broken Starlink dish. Talking over the agent pausing mid-sentence with a barking dog in the background, Grok voice three is the model built for exactly that chaos. It listens and
05:59 speaks directly with no clunky speech-to-text-to-speech chain in between, and it answers in under a second. It already handles millions of conversation in a day in Tesla cars, and the Starlink, it takes 20,000 calls daily across multiple languages. Roughly 70% get resolved with no human involved, and one in four sales calls ends in a purchase before the caller hangs up. One agent verifies the customer, troubleshoots the hardware, and issues credit and ships a replacement.
06:32 And you just saw the demo. If you look at the benchmarks, this is a scoreboard where Grok voice three sits at the top of nearly every row against its older version, which we already have covered on the channel. GPT live one, Gemini 3.8 live, it leads on overall score on reasoning over spoken audio on human preference in blind calls, and on handling interruptions and turn taking, which we all also tried. The one close race is task completion, where it barely edges out its own predecessor. Uh but remember, these are
07:05 their own published figures from XAI, but since looking at their uh model, I think it was pretty good. Let me know your thoughts in the comments. On the cost, you can see that Grok voice three is just at 0.025 per task against 0.03 for GPT live one and 0.055 for GPT real time. So, it is cheaper than both. The API price is 0.08 per minute, unchanged from the previous version. So, look, very impressive uh
07:38 stuff from uh Grok. This is the first model which has really impressed me, because the quality is really uh, quite world-class. Let me know your thoughts in the comments. Also, if you want to help out the channel, please become a member and subscribe, of course, and share it. And please also subscribe to this free weekly AI newsletter at fahadmirza.substack.com. Thank you for all the support, as always, much, much appreciated.