Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation
Not on the map. Why?
Abstract (arXiv)
Dynamic urban environments are often captured by cameras placed at spatially separated locations with little or no view overlap. However, most existing 4D reconstruction methods assume densely overlapping views and struggle under sparse multi-location observations, producing unstable reconstructions in unobserved intermediate regions. To address this practical yet underexplored setting, we propose Stitch4D, a unified 4D reconstruction framework that compensates for missing spatial coverage in sparsely observed urban environments. Stitch4D synthesizes intermediate bridge views between distant camera locations and jointly optimizes real and synthesized observations in a unified coordinate frame with inter-location consistency constraints. By recovering intermediate spatial coverage before optimization, Stitch4D mitigates geometric collapse and improves reconstruction stability in sparse regions. To evaluate this setting, we introduce Urban Sparse 4D (U-S4D), a controlled CARLA-based benchmark for free-viewpoint reconstruction under sparse multi-location configurations. Experiments on U-S4D show that Stitch4D consistently outperforms representative 4D reconstruction baselines in image-quality metrics. These results suggest that recovering intermediate spatial coverage is an effective strategy for stabilizing 4D reconstruction in sparse urban environments. The project page is provided in https://stitch4d-project-page.vercel.app/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 55 of its 64 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
55 of 64 references.
References · 55
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2018Panoptic Segmentationcited by 796
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
38 more
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 20253D and 4D World Modeling: A Surveycited by 64
- 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 53
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
- 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 40
- 2024360+x: A Panoptic Multi-modal Scene Understanding Datasetcited by 35
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 35
- 2024S-NeRF++: Autonomous Driving Simulation via Neural Reconstruction and Generationcited by 28
- 2025CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Drivingcited by 25
- 2024SplatFlow: Self-Supervised Dynamic Gaussian Splatting in Neural Motion Flow Field for Autonomous Drivingcited by 20
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusioncited by 18
- 2025AD-GS: Object-Aware B-Spline Gaussian Splatting for Self-Supervised Autonomous Drivingcited by 17
- 2025Compositional Generative Model of Unbounded 4D Citiescited by 16
- 20257DGS: Unified Spatial-Temporal-Angular Gaussian Splattingcited by 16
- 2023CityRefer: Geography-aware 3D Visual Grounding Dataset on City-scale Point Cloud Datacited by 15
- 2024EMD: Explicit Motion Modeling for High-Quality Street Gaussian Splattingcited by 13
- 2024Extrapolated Urban View Synthesis Benchmarkcited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 12
- 20254D Gaussian Splatting SLAMcited by 10
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.