mlsanityData to 7 Oct 2026

Mode-GS: Monocular Depth Guided Anchored 3D Gaussian Splatting for Robust Ground-View Scene Rendering

arXiv 2410.04646 ↗First posted 6 Oct 2024cs.CV cs.ROcited by 5

Not on the map. Why?

Abstract (arXiv)

We present a novel-view rendering algorithm, Mode-GS, for ground-robot trajectory datasets. Our approach is based on using anchored Gaussian splats, which are designed to overcome the limitations of existing 3D Gaussian splatting algorithms. Prior neural rendering methods suffer from severe splat drift due to scene complexity and insufficient multi-view observation, and can fail to fix splats on the true geometry in ground-robot datasets. Our method integrates pixel-aligned anchors from monocular depths and generates Gaussian splats around these anchors using residual-form Gaussian decoders. To address the inherent scale ambiguity of monocular depth, we parameterize anchors with per-view depth-scales and employ scale-consistent depth loss for online scale calibration. Our method results in improved rendering performance, based on PSNR, SSIM, and LPIPS metrics, in ground scenes with free trajectory patterns, and achieves state-of-the-art rendering performance on the R3LIVE odometry dataset and the Tanks and Temples dataset.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 43 references that are in the map. First posted on arXiv 6 Oct 2024.

Builds on

35 of 43 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  5. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  6. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  7. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  8. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  9. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  10. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
  11. 2023Gaussian Splatting SLAMcited by 410
  12. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
23 more
  1. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  2. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  3. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  4. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  5. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  6. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
  7. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  8. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  9. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  10. 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 153
  11. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
  12. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
  13. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  14. 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
  15. 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
  16. 2024Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Mapscited by 54
  17. 2021R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping packagecited by 49
  18. 2024Relaxing Accurate Initialization Constraint for 3D Gaussian Splattingcited by 33
  19. 2024SAGS: Structure-Aware 3D Gaussian Splattingcited by 21
  20. 2024MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densificationcited by 16
  21. 2024PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generationcited by 13
  22. 2024Radiance Fields for Robotic Teleoperationcited by 13
  23. 2023UAV-Sim: NeRF-based Synthetic Data Generation for UAV-based Perceptioncited by 10

Built on by

Cited by year

Citing papers per year: 2025: 5.

5 papers.