mlsanityData to 14 Oct 2026

DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing

arXiv 2608.01761 ↗First posted 3 Aug 2026cs.CVcited by 0

On the map: End-to-end autonomous driving → Generative simulation for driving

Abstract (arXiv)

End-to-end (E2E) autonomous driving algorithms require rigorous closed-loop validation in simulation environments offering high visual fidelity, strong interactivity, and real-time performance. Existing approaches, from game engines to static neural rendering, inherently trade off these requirements and struggle with the dynamic scene composition essential for E2E testing. To bridge this gap, we propose a novel decoupled 3D Gaussian Splatting (3DGS) framework tailored for large-scale E2E evaluation. We fundamentally decompose scenes into a high-fidelity static background and manipulable dynamic agents using an object-centric canonical representation. To resolve resulting representational conflicts, we introduce three targeted modules: (1) asset compression via perceptual pruning and vector quantization for real-time traffic rendering; (2) map-guided geometric registration leveraging semantic topology to strictly align trajectories; and (3) proxy-based relighting transferring ambient illumination for seamless photometric integration. Extensive experiments demonstrate that DecoupleGS achieves a balanced fidelity-efficiency trade-off, improves metric and photometric consistency, and provides a practical closed-loop sensor simulation platform for E2E autonomous driving evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 44 of its 48 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

44 of 48 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025RealEngine: Simulating Autonomous Driving in Realistic Context22 May
  2. 2025Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving23 Mar
  3. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
  4. 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving1 Aug
  5. 2024OASim: an Open and Adaptive Simulator based on Neural Rendering for Autonomous Driving6 Feb
  6. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 38

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  7. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  10. 2022Planning-oriented Autonomous Drivingcited by 1,087
  11. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  12. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
26 more
  1. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  2. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  3. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
  4. 2017End-to-end Driving via Conditional Imitation Learningcited by 485
  5. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  6. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
  7. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
  8. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  9. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  10. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  11. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
  12. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  13. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
  14. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  15. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
  16. 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
  17. 2025Pseudo-Simulation for Autonomous Drivingcited by 150
  18. 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 138
  19. 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
  20. 2020LGSVL Simulator: A High Fidelity Simulator for Autonomous Drivingcited by 121
  21. 2021Unsupervised Discovery of Object Radiance Fieldscited by 101
  22. 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 62
  23. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 39
  24. 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
  25. 2024Relighting Scenes with Object Insertions in Neural Radiance Fieldscited by 5
  26. 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
  2. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulation
  3. 2026ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction
  4. 2025CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Driving
  5. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
  6. 2026RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos
  7. 2026Instant NuRec: Feed-Forward 3D Gaussian Reconstruction for Driving Scene Simulation
  8. 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation