Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation
Not on the map. Why?
Abstract (arXiv)
Sensor simulation is pivotal for scalable validation of autonomous driving systems, yet existing Neural Radiance Fields (NeRF) based methods face applicability and efficiency challenges in industrial workflows. This paper introduces a Gaussian Splatting (GS) based system to address these challenges: We first break down sensor simulator components and analyze the possible advantages of GS over NeRF. Then in practice, we refactor three crucial components through GS, to leverage its explicit scene representation and real-time rendering: (1) choosing the 2D neural Gaussian representation for physics-compliant scene and sensor modeling, (2) proposing a scene editing pipeline to leverage Gaussian primitives library for data augmentation, and (3) coupling a controllable diffusion model for scene expansion and harmonization. We implement this framework on a proprietary autonomous driving dataset supporting cameras and LiDAR sensors. We demonstrate through ablation studies that our approach reduces frame-wise simulation latency, achieves better geometric and photometric consistency, and enables interpretable explicit scene editing and expansion. Furthermore, we showcase how integrating such a GS-based sensor simulator with traffic and dynamic simulators enables full-stack testing of end-to-end autonomy algorithms. Our work provides both algorithmic insights and practical validation, establishing GS as a cornerstone for industrial-grade sensor simulation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 52 of its 61 references that are in the map. First posted on arXiv 14 Mar 2025.
Builds on
52 of 61 references.
References · 52
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2024Depth Anything V2cited by 1,422
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
38 more
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2023GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorizationcited by 87
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 69
- 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 62
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 58
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2024On Scaling Up 3D Gaussian Splatting Trainingcited by 49
- 2024On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategycited by 39
- 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 39
- 2024LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Drivingcited by 33
- 2024FreeSim: Toward Free-viewpoint Camera Simulation in Driving Scenescited by 30
- 2023What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discoverycited by 27
- 2024LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesiscited by 27
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2022DriveFuzz: Discovering Autonomous Driving Bugs through Driving Quality-Guided Fuzzingcited by 19
- 2024LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splattingcited by 15
- 2025GS-LiDAR: Generating Realistic LiDAR Point Clouds with Panoramic Gaussian Splattingcited by 13
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Uni-Gaussians: Unifying Camera and Lidar Simulation with Gaussians for Dynamic Driving Scenarios
- 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
- 2026RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos
- 2026ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction
- 2026Instant NuRec: Feed-Forward 3D Gaussian Reconstruction for Driving Scene Simulation
- 2025RGE-GS: Reward-Guided Expansive Driving Scene Reconstruction via Diffusion Priors