mlsanityData to 14 Oct 2026

Visual Geometry Foundation-Aware Gaussians for Single-Frame Surround-View Driving Reconstruction

arXiv 2608.10682 ↗First posted 11 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Single-frame surround-view reconstruction faces severe geometric instability and rendering artifacts due to minimal inter-camera overlap. While existing methods rely on complex decoders or auxiliary cues, they remain bottlenecked by the weak geometric capacity of upstream features. We argue that leveraging pretrained visual geometry priors strengthens upstream representations and alleviates the geometric ambiguity in sparse surround views. To this end, we propose VGGD, a visual geometry foundation-aware 3D Gaussian Splatting framework for feed-forward surround-view driving reconstruction, which shifts geometric modeling to the frontend and adapts foundation priors to the driving camera setting. First, VGGD leverages VGGT to provide transferable multi-view geometric prior tokens. Next, we introduce a Dual-Path Neck to decouple geometry-consistent and appearance-aware representations, improving appearance completion in weakly observed regions. We further apply Scale Warmup to stabilize early geometry learning and suppress scale drift under ego-pose changes. Finally, we use a hybrid pixel--volume Gaussian decoder to produce a renderable 3D Gaussian scene for novel-view synthesis. Experiments on the nuScenes single-frame benchmark show that VGGD achieves the best overall rendering quality among the compared methods and improves relative geometric consistency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 47 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

41 of 47 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  8. 2021Vision Transformers for Dense Predictioncited by 1,803
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2024Depth Anything V2cited by 1,422
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
29 more
  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  2. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  3. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  5. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  6. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  7. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  8. 2023Gaussian Splatting SLAMcited by 415
  9. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  10. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  11. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  12. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  13. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  14. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  15. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
  16. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  17. 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 104
  18. 2023MuRF: Multi-Baseline Radiance Fieldscited by 71
  19. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 60
  20. 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 55
  21. 2024DrivingForward: Feed-forward 3D Gaussian Splatting for Driving Scene Reconstruction from Flexible Surround-view Inputcited by 53
  22. 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 33
  23. 2024Omni-Scene: Omni-Gaussian Representation for Ego-Centric Sparse-View Scene Reconstructioncited by 32
  24. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 14
  25. 2025UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstructioncited by 10
  26. 20254D Driving Scene Generation With Stereo Forcingcited by 8
  27. 2025VGD: Visual Geometry Gaussian Splatting for Feed-Forward Surround-view Driving Reconstructioncited by 8
  28. 2026GEM-Occ: From Visual Geometry Evidence to Embodied Semantic Occupancy Memorycited by 3
  29. 2026VGOcc: Learning Visual-Geometric Gaussians for Vision-Centric 3D Driving Occupancy Predictioncited by 1

Built on by

Not cited yet.