MediaTek And NVIDIA Partner To Bring AI-powered In-Cabin Experiences To Next-Gen Vehicles

At GTC 2024 last week, MediaTek unveiled four new automotive SoCs (Systems-on-Chip) for its Dimensity Auto Cockpit portfolio. These chips boast next-generation capabilities, including NVIDIA GPUs designed to handle demanding AI workloads.

MediaTek and NVIDIA Powering the Future of In-Car Entertainment

Image credit: MediaTek

The new Dimensity Auto Cockpit SoCs pack a punch. They feature Arm-based Cortex cores leveraging the latest Armv9 instruction set architecture, along with NVIDIA’s next-generation GPU for tasks like running large language models (LLMs). This built-in NVIDIA GPU can handle real-time ray tracing graphics and even employ DLSS 3 for AI-powered upscaling.

The system is powered by NVIDIA DRIVE OS, which allows automakers to leverage NVIDIA’s software and intellectual property specifically designed for the automotive platform.

Focus on Security and Performance

To ensure robust deep-learning capabilities, the Dimensity Auto Cockpit SoCs integrate a cutting-edge ARM v9-A system alongside NVIDIA’s next-gen GPU for accelerated AI computing and RTX graphics. This AI-enabled platform allows cars to run LLMs directly, facilitating features like chatbots, content delivery to multiple displays, driver alertness detection, and other advanced AI-based safety and entertainment applications. Running applications locally offers improved security, speed, and latency.

MediaTek further emphasizes the platform’s security features: “The Dimensity Auto Cockpit incorporates hardware-based security features with support for the latest automotive safety standards to safeguard user data.”

Taking In-Cabin Entertainment to the Next Level

The Dimensity Auto Cockpit promises to revolutionize in-cabin entertainment. It integrates an NVIDIA RTX GPU, enabling ray tracing for realistic visuals and lighting effects in games. Additionally, AI upscaling and frame generation ensure smooth, high-performance gameplay.

Key Features of the Next-Gen Automotive SoC from MediaTek

  • Designed specifically for the automotive market
  • Flagship 3nm manufacturing process
  • State-of-the-art Armv9-A CPU for enhanced performance, security, and deep learning capabilities
  • NVIDIA RTX graphics with ray tracing and DLSS3 support
  • Powerful NVIDIA DLA for running LLMs at the edge, enabling Generative AI features
  • Highly integrated SoC to reduce bill of materials (BOM) costs, encompassing processors, displays, cameras, audio streams, and connectivity
  • Advanced HDR ISP supporting next-generation camera sensors
  • Multiple audio DSPs for speech and audio processing

The arrival of these SoCs in vehicles is expected by 2025, spanning entry-level to premium car models.

Source: Tom’s Hardware

Leave a Reply

Verified by MonsterInsights