Building GenAI based Simulation Environment for End-to-End Autonomous Driving

Generative AI is transforming simulation for autonomous driving, enabling data-driven and closed-loop environments that better capture the complexity of real-world scenarios. This tutorial presents an end-to-end framework for building generative simulation pipelines tailored to modern learning-based driving systems. It covers key components including world modeling and city-scale digital twins, generative synthesis of rare and safety-critical scenarios, and realistic sensor and video simulation using both graphics and neural approaches. The tutorial further discusses system-level evaluation and integration with autonomous driving stacks, providing practical guidance and open-source tools for developing scalable and reliable simulation environments.