DIAL-GS: Dynamic Instance Aware Reconstruction for Label-free Street Scenes with 4D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Urban scene reconstruction is critical for autonomous driving, enabling structured 3D representations for data synthesis and closed-loop testing. Supervised approaches rely on costly human annotations and lack scalability, while current self-supervised methods often confuse static and dynamic elements and fail to distinguish individual dynamic objects, limiting fine-grained editing. We propose DIAL-GS, a novel dynamic instance-aware reconstruction method for label-free street scenes with 4D Gaussian Splatting. We first accurately identify dynamic instances by exploiting appearance-position inconsistency between warped rendering and actual observation. Guided by instance-level dynamic perception, we employ instance-aware 4D Gaussians as the unified volumetric representation, realizing dynamic-adaptive and instance-aware reconstruction. Furthermore, we introduce a reciprocal mechanism through which identity and dynamics reinforce each other, enhancing both integrity and consistency. Experiments on urban driving scenarios show that DIAL-GS surpasses existing self-supervised baselines in reconstruction quality and instance-level editing, offering a concise yet powerful solution for urban scene modeling.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
38 of 44 references.
References · 38
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
26 more
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 174
- 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
- 2023Segment Any 3D Gaussianscited by 161
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
- 2024Improving 2D Feature Representations by 3D-Aware Fine-Tuningcited by 71
- 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
- 2024AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstructioncited by 52
- 2022READ: Large-Scale Neural Scene Rendering for Autonomous Drivingcited by 51
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2022Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understandingcited by 37
- 2023BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fieldscited by 27
- 2024VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priorscited by 25
- 2024SplatFlow: Self-Supervised Dynamic Gaussian Splatting in Neural Motion Flow Field for Autonomous Drivingcited by 20
- 2024Q-SLAM: Quadric Representations for Monocular SLAMcited by 11
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2025UnIRe: Unsupervised Instance Decomposition for Dynamic Urban Scene Reconstructioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.