GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Autonomous driving systems benefit from high-definition (HD) maps that provide critical information about road infrastructure. The online construction of HD maps offers a scalable approach to generate local vectorized maps from onboard sensor observations. Existing methods commonly adopt bird's-eye-view (BEV) features as the intermediate scene representation, encoding the surrounding space with fixed-resolution dense grids. However, map elements are spatially sparse yet require fine-grained geometric localization, making uniformly allocated BEV representations redundant and less effective for vectorized map prediction. In this work, we propose GaussianMap, an online HD map construction framework that learns an adaptive Gaussian representation of the surrounding scene. This representation consists of a set of Gaussian primitives on the BEV plane, each encoding a flexible local region with geometric properties and a feature vector, allowing the model to allocate representational capacity to map-relevant regions. To generate such a representation from sensor observations, we introduce a feed-forward Gaussian encoder that progressively refines these primitives through Gaussian interaction modeling and multi-sensor feature aggregation. The refined Gaussian representation is then splatted into a BEV feature map and decoded into vectorized map predictions. Extensive experiments on nuScenes and Argoverse 2 datasets demonstrate that GaussianMap achieves state-of-the-art performance in both camera-only and camera-LiDAR fusion settings. Our code will be made publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
42 of 52 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
30 more
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 161
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 86
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
- 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2023Online Vectorized HD Map Construction using Geometrycited by 42
- 2024GaussianAD: Gaussian-Centric End-to-End Autonomous Drivingcited by 31
- 2025MapFusion: A Novel BEV Feature Fusion Network for Multi-modal Map Constructioncited by 21
- 2024GaussianBeV: 3D Gaussian Representation meets Perception Models for BeV Segmentationcited by 20
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?cited by 9
- 2025DAMap: Distance-aware MapNet for High Quality HD Map Constructioncited by 6
- 2020Long-term map maintenance pipeline for autonomous vehiclescited by 5
- 2024HeightMapNet: Explicit Height Modeling for End-to-End HD Map Learningcited by 3
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priorscited by 2
- 2025MapRF: Weakly Supervised Online HD Map Construction via NeRF-Guided Self-Trainingcited by 2
- 2026SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Predictioncited by 2
Built on by
Not cited yet.