Google and Mercedes Team Up for Enhanced In-Car AI Assistant

Google Cloud has launched its new Automotive AI Agent, with the Mercedes-Benz CLA set to be the first model to feature this technology later this year. This Agent will expand the capabilities of the MBUX Virtual Assistant, allowing it to handle a broader range of conversational tasks for passengers.

Last year at CES 2024, Mercedes introduced their next-generation assistant but did not disclose which large language model powered its functionalities. The new assistant significantly differs from the existing MBUX, which can perform approximately two dozen in-car commands and provide information sourced from platforms like ChatGPT and Bing. While the current version activates with "Hey, Mercedes," its approach resembles that of virtual assistants like Siri or Google Assistant, often delivering static responses rather than engaging in dialogues.

Built on the Gemini large language model using Vertex AI, Google's Automotive AI Agent is designed to enable automakers to craft highly personalized and intuitive in-car assistants that exceed the current voice control system's limitations. The Agent supports interactions through multiple modes and languages and can address follow-up questions. For example, it can inform drivers about nearby Italian restaurants, offer reviews, and suggest popular dishes. The system is engineered to engage users in multi-turn conversations, retaining context from previous exchanges.

The new MBUX assistant will utilize real-time data from Google Maps, providing "fresh and factual information" on over 250 million points of interest globally, along with current traffic scenarios. Ola Källenius, CEO of Mercedes-Benz Group AG, stated, "At Mercedes-Benz, we strive to deliver a remarkable digital experience for our customers. Our collaboration with Google Cloud will enhance in-car navigation by merging advanced location insights with generative AI."

Mercedes plans to incorporate this innovative MBUX assistant into additional models in the future; however, specific vehicle details have not yet been announced.

Google, Mercedes, AI