Road Extraction from Overhead Images with Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Automatic road graph extraction from aerial and satellite images is a long-standing challenge. Existing algorithms are either based on pixel-level segmentation followed by vectorization, or on iterative graph construction using next move prediction. Both of these strategies suffer from severe drawbacks, in particular high computing resources and incomplete outputs. By contrast, we propose a method that directly infers the final road graph in a single pass. The key idea consists in combining a Fully Convolutional Network in charge of locating points of interest such as intersections, dead ends and turns, and a Graph Neural Network which predicts links between these points. Such a strategy is more efficient than iterative methods and allows us to streamline the training process by removing the need for generation of starting locations while keeping the training end-to-end. We evaluate our method against existing works on the popular RoadTracer dataset and achieve competitive results. We also benchmark the speed of our method and show that it outperforms existing approaches. This opens the possibility of in-flight processing on embedded devices.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 9 Dec 2021.
Builds on
38 of 57 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Layer Normalizationcited by 5,669
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
26 more
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2018Link Prediction Based on Graph Neural Networkscited by 832
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 277
- 2020DeeperGCN: All You Need to Train Deeper GCNscited by 250
- 2020Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learningcited by 249
- 2019Stochastic Beams and Where to Find Them: The Gumbel-Top-k Trick for Sampling Sequences Without Replacementcited by 211
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
- 2018RoadTracer: Automatic Extraction of Road Networks from Aerial Imagescited by 102
- 2019XNOR-Net++: Improved Binary Neural Networkscited by 97
- 2020Differentiable Graph Module (DGM) for Graph Convolutional Networkscited by 86
- 2018Topological Map Extraction from Overhead Imagescited by 58
- 2020Binary Graph Neural Networkscited by 34
- 2020Bi-GCN: Binary Graph Convolutional Networkcited by 28
- 2018Iterative Deep Learning for Road Topology Extractioncited by 9
- 2020Geometrically Principled Connections in Graph Neural Networkscited by 8
- 2021Graph Representation Learning for Road Type Classificationcited by 8
- 2020Green Algorithms: Quantifying the carbon footprint of computationcited by 7
- 2021Beyond Road Extraction: A Dataset for Map Update using Aerial Imagescited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.