ViSE: A Systematic Approach to Vision-Only Street-View Extrapolation
Not on the map. Why?
Abstract (arXiv)
Realistic view extrapolation is critical for closed-loop simulation in autonomous driving, yet it remains a significant challenge for current Novel View Synthesis (NVS) methods, which often produce distorted and inconsistent images beyond the original trajectory. This report presents our winning solution which ctook first place in the RealADSim Workshop NVS track at ICCV 2025. To address the core challenges of street view extrapolation, we introduce a comprehensive four-stage pipeline. First, we employ a data-driven initialization strategy to generate a robust pseudo-LiDAR point cloud, avoiding local minima. Second, we inject strong geometric priors by modeling the road surface with a novel dimension-reduced SDF termed 2D-SDF. Third, we leverage a generative prior to create pseudo ground truth for extrapolated viewpoints, providing auxilary supervision. Finally, a data-driven adaptation network removes time-specific artifacts. On the RealADSim-NVS benchmark, our method achieves a final score of 0.441, ranking first among all participants.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
18 of 23 references.
References · 18
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 90
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
6 more
- 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
- 2024AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstructioncited by 52
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
- 2024Driving View Synthesis on Free-form Trajectories with Generative Priorcited by 11
- 2025Para-Lane: Multi-Lane Dataset Registering Parallel Scans for Benchmarking Novel View Synthesiscited by 10
Built on by
Not cited yet.