Physics-Aware 3D Gaussian Editing for Driving Scene Generation
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has shown great potential in autonomous driving simulation and data generation, enabling photorealistic reconstruction and flexible scene manipulation. However, existing 3DGS scene editing methods have limited support for road geometry editing (e.g., inserting speed humps or sunken roads), and generally do not couple such edits with plausible vehicle-road interaction dynamics. Such editing is essential for generating training data under extreme driving scenarios or evaluating system reliability under these road irregularities. Moreover, many optimization-based methods require minutes of per-edit refinement, while existing efficient alternatives mainly focus on appearance-level or object-level manipulation rather than physics-aware road irregularity editing. To address these limitations, we propose RoVES, a Road-and-Vehicle Editing System for physics-aware 3D Gaussian editing in driving scenes. RoVES enables single-image-driven road geometry insertion and couples the edited road profile with a 4-DOF half-car vehicle dynamics model to achieve physics-aware vehicle pose correction in vertical displacement and pitch. RoVES inserts road elements in a one-shot, optimization-free pipeline (1.84s), and the full pipeline (including color transfer and vehicle-dynamics-based pose correction) completes in 6.24s; it edits dynamic vehicles via pose editing and corrects poses frame-by-frame to approximate dynamics-consistent vertical displacement and pitch responses. Experiments on the Waymo dataset show that RoVES provides practical efficiency and competitive visual consistency for physics-aware driving scene generation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
24 of 31 references.
References · 24
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 79
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 41
12 more
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 36
- 2024Omni-Scene: Omni-Gaussian Representation for Ego-Centric Sparse-View Scene Reconstructioncited by 32
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2024GaussianCut: Interactive segmentation via graph cut for 3D Gaussian Splattingcited by 25
- 20243DSceneEditor: Controllable 3D Scene Editing with Gaussian Splattingcited by 22
- 2025High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splattingcited by 14
- 2025Gaussian On-the-Fly Splatting: A Progressive Framework for Robust Near Real-Time 3DGS Optimizationcited by 4
- 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenescited by 4
- 2026FastPhysGS: Accelerating Physics-based Dynamic 3DGS Simulation via Interior Completion and Adaptive Optimizationcited by 4
- 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehiclescited by 3
- 2026HorizonWeaver: Generalizable Multi-Level Semantic Editing for Driving Scenescited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.