Skip to main content
  1. Home
  2. Computing
  3. News

Google’s new Agent will power Mercedes’ next in-car AI assistant

By
The Mercedes MBUX
Mercedes-Benz

Google Cloud released its new Automotive AI Agent on Monday and has named the Mercedes-Benz CLA as the first car model to offer it later this year. The Agent will enable Mercedes’ MBUX Virtual Assistant to perform a wider array of conversational functions with the vehicle’s passengers.

We got our first look at Mercedes’ next generation assistant a year ago, at CES 2024, though the company did not reveal which large language model underpinned its capabilities at the time. This new assistant differs from the existing MBUX that can activate around two dozen in-car commands and provide information sourced from ChatGPT and Bing. While the current generation assistant can be activated by stating “Hey, Mercedes,” it functions more like Siri or Google Assistant than ChatGPT’s Advanced Voice Mode, offering static responses rather than conversational replies.

Recommended Videos

Google’s Agent is built atop the Gemini LLM using Vertex AI and is geared specifically to “allow automakers to create highly personalized and intuitive in-car agents that go beyond current vehicle voice control,” per the company’s announcement post. The Agent supports both multimodal and multilingual inputs, as well as can provide answers to follow-up questions. In Google’s example, the AI will be able to tell drivers if there are any Italian restaurants nearby, then offer up reviews of the establishment and even tell you what the most popular dish there is. The system is reportedly robust enough to handle multi-turn dialog with users and remember details from previous conversations.

Related: 
Best new movies to stream on Netflix, Hulu, Prime Video, HBO Max, and more

The new MBUX assistant will reportedly pull “fresh and factual information” from Google Maps in near real time to offer “comprehensive and personalized information” about more than 250 million points of interest worldwide and current traffic conditions. “At Mercedes-Benz, we seek to offer our customers an exceptional digital experience,” said Ola Källenius, CEO of Mercedes-Benz Group AG, in a press statement. “Our partnership with Google Cloud will further enhance in-car navigation, combining sophisticated location data with generative AI.”

Mercedes plans to roll out the new MBUX assistant to additional models in the future, but has not yet specified which ones it will be integrated into.

Andrew Tarantola
Andrew Tarantola
Former Computing Writer
Andrew Tarantola is a journalist with more than a decade reporting on emerging technologies ranging from robotics and machine…
Topics

Editors’ Recommendations

AI could soon speak dog and cat
A cute dog.

Imagine what it would be like to know exactly what your dog was saying when it barked, or your cat when it miaowed, or your iguana when it ... made whatever sound an iguana makes (do they even make one?).

There have been various attempts to develop systems that enable pets to communicate -- a notable example is where dogs press programmable sound buttons, with each one representing a word or phrase, to "talk" and express needs, emotions, or observations -- but none are quite so exciting as the one proposed by Chinese tech giant Baidu in a patent filed with the China National Intellectual Property Administration.

Read more
AI enables slain man to address courtroom at killer’s sentencing
An abstract image of a person and a blue background.

In what’s believed to be a world first, artificial intelligence (AI) has allowed a slain man to address his killer at the sentencing hearing.

Christopher Pelkey was shot dead in a road rage incident in Chandler, Arizona, four years ago, but just recently, AI was used to recreate a digital version of the victim that was allowed to make a statement during the trial, a local news site reported.

Read more
Can Google’s new AI experiment help me learn a language?
AI translation on Android phone.

I've lived in Germany for around a decade now, and an enduring source of shame for me is my rather underwhelming German language skills. Like many language learners, I've reached the point where I can understand what's said to me, make casual conversation, and handle everyday situations, but I've never really achieved the level of comfort with the language and the breadth of vocabulary that's required for true fluency.

I'd love to improve my language skills, but I've struggled to commit the time and resources for intensive classes. But perhaps there's a solution hiding in plain sight on my phone.

Read more