Mercedes-Benz and Google Cloud have announced an expansion of their partnership to integrate advanced conversational AI capabilities into the MBUX Virtual Assistant. This collaboration introduces Google Cloud’s new Automotive AI Agent, enabling drivers to access detailed, real-time information and navigation support through natural-language conversations. The enhanced system is set to debut in the new Mercedes-Benz CLA series later this year, reflecting a significant leap forward in in-car digital experiences.
The Automotive AI Agent, developed using Google’s Gemini models on the Vertex AI platform, is tailored specifically for the automotive sector. It leverages Google Maps Platform to provide fresh and accurate data on over 250 million global points of interest, updated with more than 100 million changes daily. This integration allows the MBUX Virtual Assistant to offer detailed and personalised responses, addressing complex queries with memory retention for multi-turn dialogue. Drivers can ask questions such as, 'Could you guide me to the nearest fine-dining restaurant?' and follow up with queries about reviews or signature dishes, receiving accurate responses displayed on the vehicle’s interface.
Ola Källenius, CEO, Mercedes-Benz, stated “At Mercedes-Benz, we seek to offer our customers an exceptional digital experience. Our collaboration with Google Cloud combines advanced location data with generative AI, creating a next-generation navigation experience that is both intuitive and comprehensive.” The rollout will begin with the CLA series, the first model designed with the new Mercedes-Benz operating system (MB.OS), before expanding to other vehicles equipped with the MBUX Assistant.
Sundar Pichai, CEO, Google Cloud, added “Mercedes-Benz is known for providing an amazing driving experience, and our Automotive AI Agent will enhance this further by enabling more natural and helpful interactions within vehicles. This marks the beginning of a new era in how AI capabilities can shape the automotive industry.”
The Automotive AI Agent exemplifies how large language models (LLMs) and generative AI can create customised, first-party voice assistant experiences for automakers. With its multimodal reasoning capabilities and integration with Google Maps Platform, the system offers users a seamless blend of advanced technology and practical functionality.
Also Read