I can be pretty tough on AI, especially when it’s used to make misinformation slop. But as cynical as I may seem, I do acknowledge that there are plenty of useful and beneficial features that AI powers. Take live translation, for instance: Not long ago, the concept of a device that could translate someone else’s words directly in your ear as they spoke would seem like some far future technology. But not only is it not a futuristic technology, both Google and Apple have their own takes on the feature that users can take advantage of.
That said, not all iPhone and Android users alike have been able to use live translate. Both companies have limited the feature to work with their respective earbuds: For Apple, that’s the AirPods Pro 2 and AirPods Pro 3; for Google, that’s the Pixel Buds. Without your platform’s flagship earbuds, you haven’t been able to use live translation, and instead need to stick with the rest of your translation app’s experience, whether that be Apple Translate or Google Translate. Lucky for Android users, that’s no longer the case for the latter.
On Friday, Google announced new Gemini translation capabilities for its proprietary translation app. The company says these new updates introduce “state-of-the-art text translation quality,” with more nuanced, natural, and accurate translations. Importantly, however, as part of those upgrades, the company is launching a beta where all Google Translate users can access live translation through any headphones—not just Pixel Buds. This initial rollout is only available on the Android version of Google Translate in the U.S., Mexico, and India, though Google says the company will bring the feature to iOS and more regions in the next year.
This is kind of huge: Companies typically like to keep features like this locked behind their own platform as a marketing tactic. You’re more likely to buy Pixel Buds over other earbuds or headphones if you really want to try live translation. However, you don’t even need to buy a new pair of headphones to use this feature at all: As long as you have some type of headphones or earbuds connected to your Android device, you can translate conversations on the fly.
Trying Google’s live translate with Apple headphones
I gave this a shot on my Pixel 8 Pro with my AirPods Max, by playing a video of people speaking Portuguese. Set up wasn’t the simplest: First, it took forever for the Pixel to recognize my AirPods, despite the headphones being in pairing mode for some time, but that’s beside the point. The key issue was getting Google Translate to present the new beta for live translation. When I first opened it, it was using the older live translate feature, which didn’t work with my AirPods. I had the latest version running, so I uninstalled and reinstalled the app. When it launched, I didn’t have live translate at all. Finally, after force quitting and reopening the app, I got a pop-up for the new live translation beta experience.
What do you think so far?
The next part was user error: I had my language set to the target language (Portuguese), and vice versa. As such, Google assumed I would be the one speaking Portuguese, and didn’t vocalize the English translation. Once I flipped the languages, and confirmed that English would be spoken through my headphones, the feature started working—and well, for that matter. The video I choose was taken from a news broadcast, with two anchors, and various speakers during news segments. Once the video started, I could see Google Translation translating the words on my screen, and, after about four seconds, I heard the audio translated in my hear. Google Translate even tries to match the speaker’s voice, and though it certainly isn’t a deepfake, it does well enough to distinguish different speakers from one another. It even tried to take on more a serious tone to match the anchor’s, versus the more casual tone of one of the people interviewed in a news segment.
I tried a couple of other videos in different languages, but this time, using the “Detect language” feature rather than a preset target language. The app was able to recognize this video was spoken in Thai, and this one was spoken in Urdu, and translated both accordingly. And while I can’t verify the quality of the translation (I am sadly not fluent in any other language), the experience was overall easy enough to follow. The speed of speech can get a bit slow at times, perhaps because the AI has a lot to process at once, but as long as you turn up the volume on your headphones, it’s easy enough to follow.
All that to say, I’m very interested to give this a try in a real world scenario. Even though my daily driver is an iPhone, I might need to start carrying around my Pixel 8 Pro just in case.
