Cerence Inc., a leader in conversational AI for automotive user experiences, has announced a groundbreaking partnership with MediaTek and an expanded collaboration with NVIDIA. Together, they will showcase the next generation of CaLLM™ Edge, a small language model (SLM) designed specifically for automotive applications. The new capabilities of CaLLM Edge will be demonstrated for the first time at Auto Shanghai 2025, revolutionizing in-car interactions with multi-modal capabilities powered by NVIDIA’s AI Enterprise software. This advancement is poised to make car experiences smarter, safer, and more human-like than ever before.
Innovations in CaLLM™ Edge for Automotive User Experiences
1. Enhanced Multi-Modal Capabilities
The new CaLLM Edge integrates seamlessly into Cerence xUI, the company’s hybrid cloud/embedded agentic AI platform. Powered by NVIDIA AI Enterprise and MediaTek’s Dimensity Auto Cockpit chipsets, this system delivers advanced multi-modal capabilities. It fine-tunes in-vehicle performance and efficiency, offering more contextual awareness both inside and outside the vehicle. This partnership allows automakers to provide personalized in-car experiences that adapt to individual passenger needs.
2. Smarter In-Car Interactions
Imagine a vehicle that understands when you’re engaging in conversation and when you’re not. CaLLM Edge can recognize context, allowing for seamless dialogue between the driver and passengers. For example, a driver can request restaurant recommendations, and then ask the passenger for input without interruption. The assistant understands to wait for the passenger’s response before continuing. Additionally, it can multitask—responding to both the driver and passengers at the same time. This real-time contextual awareness provides more dynamic and responsive in-car interactions.
3. Bringing the Outside World In
CaLLM Edge also enhances contextual awareness beyond the car. It can interpret road signs, identify roadside buildings, or provide insights into advertisements displayed on billboards. The system leverages sensor data and camera feeds both inside and outside the vehicle, streamlining real-time information processing at the edge.
4. Smart Guardrails for Safety
In collaboration with NVIDIA NeMo Guardrails, Cerence has developed smart guardrails optimized for NVIDIA DRIVE AGX. These guardrails ensure that Cerence-powered systems operate safely and reliably, maintaining context-awareness while minimizing distractions. The system also ensures compliance with industry safety standards, even in low-connectivity environments.
Benefits for Automakers and Consumers
5. Cost-Efficiency and Reduced Cloud Bandwidth
By processing multi-modal data at the edge, CaLLM Edge reduces the need for constant cloud interaction, decreasing bandwidth usage and costs for Original Equipment Manufacturers (OEMs). This innovation enhances efficiency for automakers, enabling scalable deployments with fewer reliance on cloud infrastructure.
6. Unlocking New Revenue Streams for OEMs
With AI-powered generative capabilities, CaLLM Edge offers automakers the opportunity to create subscription-based services and new revenue streams. As the system delivers more advanced, contextual features to drivers, it opens doors for automakers to offer premium, personalized in-car experiences.
Industry Recognition and Expert Insights
7. Cerence’s Vision for the Future of In-Vehicle AI
“By teaming up with MediaTek and NVIDIA, we’ve supercharged CaLLM Edge with real-time perception and contextual awareness, reshaping the future of in-vehicle experiences,” said Nils Schanz, EVP, Product & Technology at Cerence AI. This partnership marks a significant step forward in conversational AI, aligning with Cerence’s mission to continuously enhance automotive infotainment systems.
8. MediaTek’s and NVIDIA’s Contributions
“The combination of Cerence’s CaLLM Edge and MediaTek Dimensity Auto platforms is a game-changer for the automotive industry,” said Mike Chang, Corporate VP of MediaTek’s Automotive Business. Cerence’s work with NVIDIA continues to push the limits of AI integration, creating more intelligent and responsive car environments.
“NVIDIA’s partnership with Cerence offers automakers the ability to customize voice experiences with greater flexibility, while NVIDIA NeMo Guardrails ensure safety and scalability,” said Rishi Dhall, VP of Automotive at NVIDIA.
Auto Shanghai 2025: Experience the Future of In-Car AI
At Auto Shanghai 2025, Cerence will showcase Cerence xUI powered by NVIDIA DRIVE AGX, integrated into a production-ready automotive reference design. This interactive, real-world demonstration will feature a multi-seat environment, enabling personalized interaction for drivers and passengers alike. Attendees can visit Cerence and MediaTek at Hall 8.2, booths 8BD002 and 8BE006, to experience this next-gen automotive AI platform firsthand.
The Future of Automotive AI is Here
With the introduction of CaLLM Edge, Cerence, along with MediaTek and NVIDIA, is setting a new standard for in-vehicle AI. By enabling multi-modal interactions and integrating advanced AI-driven features at the edge, this collaboration is paving the way for smarter, safer, and more context-aware automotive experiences. As AI continues to revolutionize the automotive industry, CaLLM Edge is at the forefront of this transformation.
