AD-GS: Object-Aware B-Spline Gaussian Splatting for Self-Supervised Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Modeling and rendering dynamic urban driving scenes is crucial for self-driving simulation. Current high-quality methods typically rely on costly manual object tracklet annotations, while self-supervised approaches fail to capture dynamic object motions accurately and decompose scenes properly, resulting in rendering artifacts. We introduce AD-GS, a novel self-supervised framework for high-quality free-viewpoint rendering of driving scenes from a single log. At its core is a novel learnable motion model that integrates locality-aware B-spline curves with global-aware trigonometric functions, enabling flexible yet precise dynamic object modeling. Rather than requiring comprehensive semantic labeling, AD-GS automatically segments scenes into objects and background with the simplified pseudo 2D segmentation, representing objects using dynamic Gaussians and bidirectional temporal visibility masks. Further, our model incorporates visibility reasoning and physically rigid regularization to enhance robustness. Extensive evaluations demonstrate that our annotation-free model significantly outperforms current state-of-the-art annotation-free methods and is competitive with annotation-dependent approaches.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
35 of 44 references.
References · 35
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2024Depth Anything V2cited by 1,422
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
23 more
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
- 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
- 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2024Dynamic 3D Gaussian Fields for Urban Areascited by 35
- 2024Multi-Level Neural Scene Graphs for Dynamic Urban Environmentscited by 27
- 2024SplatFlow: Self-Supervised Dynamic Gaussian Splatting in Neural Motion Flow Field for Autonomous Drivingcited by 20
- 2024RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenescited by 14
- 2024LiHi-GS: LiDAR-Supervised Gaussian Splatting for Highway Driving Scene Reconstructioncited by 8
- 2024UrbanGS: Semantic-Guided Gaussian Splatting for Urban Scene Reconstructioncited by 7
Built on by
Citing papers per year: 2025: 6; 2026: 11.
17 papers.
Sort:
By area:
- 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 33
- 2025UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstructioncited by 10
- 2025Consistent Instance Field for Dynamic Scene Understandingcited by 5
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenescited by 3
- 20254DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radarcited by 2
- 2026EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priorscited by 2
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attentioncited by 1
- 2025DriveSplat: Unified Neural Gaussian Reconstruction for Dynamic Driving Scenescited by 0
- 2026Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstructioncited by 0
- 2026Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolationcited by 0
- 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wildcited by 0
5 more
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenescited by 0
- 2026SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splattingcited by 0
- 2026L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstructioncited by 0
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
- 2026L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstruction28 Jun 2026
- 2026SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting27 Jun 2026
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes10 May 2026
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generation9 May 2026
- 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wild30 Apr 2026
- 2026EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priors29 Apr 2026
- 2026Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation9 Apr 2026
- 2026Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction7 Apr 2026
- 2025Consistent Instance Field for Dynamic Scene Understanding16 Dec 2025
5 more
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenes24 Nov 2025
- 2025UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstruction6 Nov 2025
- 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct 2025
- 20254DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar16 Sep 2025
- 2025DriveSplat: Unified Neural Gaussian Reconstruction for Dynamic Driving Scenes21 Aug 2025
- 2025UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstructioncited by 10
- 2025Consistent Instance Field for Dynamic Scene Understandingcited by 5
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 4
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenescited by 3
- 20254DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radarcited by 2
- 2026EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priorscited by 2
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attentioncited by 1
- 2025DriveSplat: Unified Neural Gaussian Reconstruction for Dynamic Driving Scenescited by 0
- 2026Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstructioncited by 0
- 2026Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolationcited by 0
- 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wildcited by 0
- 2026SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splattingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
- 2026SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting27 Jun 2026
- 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generation9 May 2026
- 2026Difix3D-W: Distractor-Free Few-Shot 3D Gaussian Splatting in the Wild30 Apr 2026
- 2026EnerGS: Energy-Based Gaussian Splatting with Partial Geometric Priors29 Apr 2026
- 2026Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation9 Apr 2026
- 2026Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction7 Apr 2026
- 2025Consistent Instance Field for Dynamic Scene Understanding16 Dec 2025
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenes24 Nov 2025
- 2025UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstruction6 Nov 2025
- 20254DRadar-GS: Self-Supervised Dynamic Driving Scene Reconstruction with 4D Radar16 Sep 2025
12 newest of 13 All 13 (JSON)