mlsanityData to 7 Oct 2026

Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Models

arXiv 2405.00620 ↗First posted 1 May 2024cs.CVcited by 4

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

The lane graph is critical for applications such as autonomous driving and lane-level route planning. While previous research has focused on extracting lane-level graphs from aerial imagery using convolutional neural networks (CNNs) followed by post-processing segmentation-to-graph algorithms, these methods often face challenges in producing sharp and complete segmentation masks. Challenges such as occlusions, variations in lighting, and changes in road texture can lead to incomplete and inaccurate lane masks, resulting in poor-quality lane graphs. To address these challenges, we propose a novel approach that refines the lane masks, output by a CNN, using diffusion models. Experimental results on a publicly available dataset demonstrate that our method outperforms existing methods based solely on CNNs or diffusion models, particularly in terms of graph connectivity. Our lane mask refinement approach enhances the quality of the extracted lane graph, yielding gains of approximately 1.5% in GEO F1 and 3.5% in TOPO F1 scores over the best-performing CNN-based method, and improvements of 28% and 34%, respectively, compared to a prior diffusion-based approach. Both GEO F1 and TOPO F1 scores are critical metrics for evaluating lane graph quality. Additionally, ablation studies are conducted to evaluate the individual components of our approach, providing insights into their respective contributions and effectiveness.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 30 of its 41 references that are in the map. First posted on arXiv 1 May 2024.

Builds on

30 of 41 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  11. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  12. 2018Graph R-CNN for Scene Graph Generationcited by 296
18 more
  1. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
  2. 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
  3. 2021Diffusion Models for Implicit Image Segmentation Ensemblescited by 198
  4. 2022Scalable Adaptive Computation for Iterative Generationcited by 190
  5. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
  6. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  7. 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
  8. 2020DAGMapper: Learning to Map by Discovering Lane Topologycited by 49
  9. 2020Hierarchical Recurrent Attention Networks for Structured Online Mapscited by 38
  10. 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
  11. 2023Learning and Aggregating Lane Graphs for Urban Automated Drivingcited by 20
  12. 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
  13. 2021Automatic Construction of Lane-level HD Maps for Urban Scenescited by 15
  14. 2021Critic Guided Segmentation of Rewarding Objects in First-Person Viewscited by 12
  15. 2023Building Lane-Level Maps from Aerial Imagescited by 12
  16. 2018Aerial LaneNet: Lane Marking Semantic Segmentation in Aerial Imagery using Wavelet-Enhanced Cost-sensitive Symmetric Fully Convolutional Neural Networkscited by 11
  17. 2021Hierarchical Road Topology Learning for Urban Map-less Drivingcited by 4
  18. 2022Stroke-based Rendering: From Heuristics to Deep Learningcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MapDreamer: Aerial Imagery Conditioned Latent Diffusion for Lane-Level Map Generation
  2. 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving
  3. 2025LDPoly: Latent Diffusion for Polygonal Road Outline Extraction in Large-Scale Topographic Mapping
  4. 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation
  5. 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Images
  6. 2022CenterLineDet: CenterLine Graph Detection for Road Lanes with Vehicle-mounted Sensors by Transformer for HD Map Generation
  7. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
  8. 2023Graph-based Topology Reasoning for Driving Scenes