HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes
Not on the map. Why?
Abstract (arXiv)
Online dense mapping of urban scenes forms a fundamental cornerstone for scene understanding and navigation of autonomous vehicles. Recent advancements in mapping methods are mainly based on NeRF, whose rendering speed is too slow to meet online requirements. 3D Gaussian Splatting (3DGS), with its rendering speed hundreds of times faster than NeRF, holds greater potential in online dense mapping. However, integrating 3DGS into a street-view dense mapping framework still faces two challenges, including incomplete reconstruction due to the absence of geometric information beyond the LiDAR coverage area and extensive computation for reconstruction in large urban scenes. To this end, we propose HGS-Mapping, an online dense mapping framework in unbounded large-scale scenes. To attain complete construction, our framework introduces Hybrid Gaussian Representation, which models different parts of the entire scene using Gaussians with distinct properties. Furthermore, we employ a hybrid Gaussian initialization mechanism and an adaptive update method to achieve high-fidelity and rapid reconstruction. To the best of our knowledge, we are the first to integrate Gaussian representation into online dense mapping of urban scenes. Our approach achieves SOTA reconstruction accuracy while only employing 66% number of Gaussians, leading to 20% faster reconstruction speed.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 29 Mar 2024.
Builds on
43 of 53 references.
References · 43
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
31 more
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2020Virtual KITTI 2cited by 345
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2021Urban Radiance Fieldscited by 263
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 107
- 2023Neural LiDAR Fields for Novel View Synthesiscited by 65
- 2024RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operationcited by 62
- 2020The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truthcited by 61
- 2023Real-Time Neural Rasterization for Large Scenescited by 37
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2023GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understandingcited by 20
- 2023LightSim: Neural Lighting Simulation for Urban Scenescited by 20
- 2023City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Webcited by 14
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 3.
11 papers.
- 2024Extrapolated Urban View Synthesis Benchmarkcited by 13
- 2024XLD: A Cross-Lane Dataset for Benchmarking Novel Driving View Synthesiscited by 9
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2024GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Drivingcited by 7
- 2025GS-LTS: 3D Gaussian Splatting-Based Adaptive Modeling for Long-Term Service Robotscited by 6
- 2025GRAND-SLAM: Local Optimization for Globally Consistent Large-Scale Multi-Agent Gaussian SLAMcited by 4
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splattingcited by 1
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splattingcited by 1
- 2025LIVE-GS: Online LiDAR-Inertial-Visual State Estimation and Globally Consistent Mapping with 3D Gaussian Splattingcited by 0
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priorscited by 0
- 2026Two-View Accumulation as the Primary Training Lever for Hybrid-Capture Gaussian Splatting: A Variance-Decomposition View of When Gradient Surgery Helpscited by 0
- 2026Two-View Accumulation as the Primary Training Lever for Hybrid-Capture Gaussian Splatting: A Variance-Decomposition View of When Gradient Surgery Helps29 Apr 2026
- 2026GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors13 Apr 2026
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting9 Apr 2026
- 2025SVR-GS: Spatially Variant Regularization for Probabilistic Masks in 3D Gaussian Splatting14 Sep 2025
- 2025LIVE-GS: Online LiDAR-Inertial-Visual State Estimation and Globally Consistent Mapping with 3D Gaussian Splatting31 Jul 2025
- 2025GRAND-SLAM: Local Optimization for Globally Consistent Large-Scale Multi-Agent Gaussian SLAM23 Jun 2025
- 2025GS-LTS: 3D Gaussian Splatting-Based Adaptive Modeling for Long-Term Service Robots22 Mar 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2024Extrapolated Urban View Synthesis Benchmark6 Dec 2024
- 2024GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Driving1 Oct 2024
- 2024XLD: A Cross-Lane Dataset for Benchmarking Novel Driving View Synthesis26 Jun 2024