MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models
Not on the map. Why?
Abstract (arXiv)
Despite tremendous advancements in bird's-eye view (BEV) perception, existing models fall short in generating realistic and coherent semantic map layouts, and they fail to account for uncertainties arising from partial sensor information (such as occlusion or limited coverage). In this work, we introduce MapPrior, a novel BEV perception framework that combines a traditional discriminative BEV perception model with a learned generative model for semantic map layouts. Our MapPrior delivers predictions with better accuracy, realism, and uncertainty awareness. We evaluate our model on the large-scale nuScenes benchmark. At the time of submission, MapPrior outperforms the strongest competing method, with significantly improved MMD and ECE scores in camera- and LiDAR-based BEV perception.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 65 of its 88 references that are in the map. First posted on arXiv 24 Aug 2023.
Builds on
65 of 88 references.
References · 65
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
38 more
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Image Transformercited by 772
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 327
- 2019Verified Uncertainty Calibrationcited by 309
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
- 2015Conditional Random Fields as Recurrent Neural Networkscited by 214
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2024: 9; 2025: 6; 2026: 6.
21 papers.
Sort:
By area:
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2024DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Modelcited by 13
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Datacited by 5
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priorscited by 5
- 2024Predictive Uncertainty Quantification for Bird's Eye View Segmentation: A Benchmark and Novel Loss Functioncited by 2
- 2024Progressive Query Refinement Framework for Bird's-Eye-View Semantic Segmentation from Surrounding Imagescited by 2
- 2024VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantizationcited by 2
- 2025Diffusion-Based Generative Models for 3D Occupancy Prediction in Autonomous Drivingcited by 2
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Drivingcited by 2
- 2025BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentationcited by 2
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
9 more
- 2026What's Hidden Matters: Identifying Planning-Critical Occluded Agents using Vision-Language Modelscited by 1
- 2024Addressing Diverging Training Costs using BEVRestore for High-resolution Bird's Eye View Map Constructioncited by 0
- 2025L2G-Map: Local-to-Global Mapping via Hierarchical Diffusion Refinement and Elliptical Bayesian Fusioncited by 0
- 2025MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perceptioncited by 0
- 2026CycleBEV: Regularizing View Transformation Networks via View Cycle Consistency for Bird's-Eye-View Semantic Segmentationcited by 0
- 2026FlatLands: Generative Floormap Completion From a Single Egocentric Viewcited by 0
- 2026GSMap: 2D Gaussians for Online HD Mappingcited by 0
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Drivingcited by 0
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Priorcited by 0
- 2026What's Hidden Matters: Identifying Planning-Critical Occluded Agents using Vision-Language Models1 Jul 2026
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior30 Jun 2026
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving15 Jun 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026FlatLands: Generative Floormap Completion From a Single Egocentric View16 Mar 2026
- 2026CycleBEV: Regularizing View Transformation Networks via View Cycle Consistency for Bird's-Eye-View Semantic Segmentation27 Feb 2026
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving28 Sep 2025
- 2025MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perception22 Sep 2025
- 2025BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation13 Aug 2025
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Driving31 Jul 2025
- 2025Diffusion-Based Generative Models for 3D Occupancy Prediction in Autonomous Driving29 May 2025
- 2025L2G-Map: Local-to-Global Mapping via Hierarchical Diffusion Refinement and Elliptical Bayesian Fusion4 Mar 2025
9 more
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert17 Dec 2024
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priors26 Nov 2024
- 2024VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization3 Nov 2024
- 2024Progressive Query Refinement Framework for Bird's-Eye-View Semantic Segmentation from Surrounding Images24 Jul 2024
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Data11 Jul 2024
- 2024Predictive Uncertainty Quantification for Bird's Eye View Segmentation: A Benchmark and Novel Loss Function31 May 2024
- 2024DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Model3 May 2024
- 2024Addressing Diverging Training Costs using BEVRestore for High-resolution Bird's Eye View Map Construction2 May 2024
- 2024LidarDM: Generative LiDAR Simulation in a Generated World3 Apr 2024
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Datacited by 5
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priorscited by 5
- 2024Predictive Uncertainty Quantification for Bird's Eye View Segmentation: A Benchmark and Novel Loss Functioncited by 2
- 2024Progressive Query Refinement Framework for Bird's-Eye-View Semantic Segmentation from Surrounding Imagescited by 2
- 2024VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantizationcited by 2
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Drivingcited by 2
- 2024Addressing Diverging Training Costs using BEVRestore for High-resolution Bird's Eye View Map Constructioncited by 0
- 2025L2G-Map: Local-to-Global Mapping via Hierarchical Diffusion Refinement and Elliptical Bayesian Fusioncited by 0
- 2025MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perceptioncited by 0
- 2026CycleBEV: Regularizing View Transformation Networks via View Cycle Consistency for Bird's-Eye-View Semantic Segmentationcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior30 Jun 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026FlatLands: Generative Floormap Completion From a Single Egocentric View16 Mar 2026
- 2026CycleBEV: Regularizing View Transformation Networks via View Cycle Consistency for Bird's-Eye-View Semantic Segmentation27 Feb 2026
- 2025MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perception22 Sep 2025
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Driving31 Jul 2025
- 2025L2G-Map: Local-to-Global Mapping via Hierarchical Diffusion Refinement and Elliptical Bayesian Fusion4 Mar 2025
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert17 Dec 2024
- 2024Enhancing Lane Segment Perception and Topology Reasoning with Crowdsourcing Trajectory Priors26 Nov 2024
- 2024VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization3 Nov 2024
- 2024Progressive Query Refinement Framework for Bird's-Eye-View Semantic Segmentation from Surrounding Images24 Jul 2024
- 2024Map It Anywhere (MIA): Empowering Bird's Eye View Mapping using Large-scale Public Data11 Jul 2024
12 newest of 15 All 15 (JSON)