# SPIN Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving

arXiv: https://arxiv.org/abs/2109.07701 · HTML: https://mlsanity.com/paper/2109.07701/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 46 references that are in the map.
- First posted on arXiv 16 Sep 2021.

## Builds on (most cited first, 21 of 21)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](https://mlsanity.com/paper/1704.04861/) (2017)
- [SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation](https://mlsanity.com/paper/1511.00561/) (2015)
- [Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics](https://mlsanity.com/paper/1705.07115/) (2017)
- [Multi-Scale Context Aggregation by Dilated Convolutions](https://mlsanity.com/paper/1511.07122/) (2015)
- [Stacked Hourglass Networks for Human Pose Estimation](https://mlsanity.com/paper/1603.06937/) (2016)
- [DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images](https://mlsanity.com/paper/1805.06561/) (2018)
- [Videos as Space-Time Region Graphs](https://mlsanity.com/paper/1806.01810/) (2018)
- [LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentation](https://mlsanity.com/paper/1707.03718/) (2017)
- [Graph-Based Global Reasoning Networks](https://mlsanity.com/paper/1811.12814/) (2018)
- [RoadTracer: Automatic Extraction of Road Networks from Aerial Images](https://mlsanity.com/paper/1802.03680/) (2018)
- [Beyond the Pixel-Wise Loss for Topology-Aware Delineation](https://mlsanity.com/paper/1712.02190/) (2017)
- [Spatial Pyramid Based Graph Reasoning for Semantic Segmentation](https://mlsanity.com/paper/2003.10211/) (2020)
- [Global Aggregation then Local Distribution in Fully Convolutional Networks](https://mlsanity.com/paper/1909.07229/) (2019)
- [iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Driving](https://mlsanity.com/paper/2103.17118/) (2021)
- [Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Driving](https://mlsanity.com/paper/2103.17119/) (2021)
- [Hyperspectral Pansharpening Based on Improved Deep Image Prior and Residual Reconstruction](https://mlsanity.com/paper/2107.02630/) (2021)
- [Aerial image geolocalization from recognition and matching of roads and intersections](https://mlsanity.com/paper/1605.08323/) (2016)

## Built on by (most cited first, 18 of 18)

- [A Transformer-Based Siamese Network for Change Detection](https://mlsanity.com/paper/2201.01293/) (2022)
- [Graph-based Topology Reasoning for Driving Scenes](https://mlsanity.com/paper/2304.05277/) (2023)
- [TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoning](https://mlsanity.com/paper/2310.06753/) (2023)
- [HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening](https://mlsanity.com/paper/2203.02503/) (2022)
- [TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes](https://mlsanity.com/paper/2405.14747/) (2024)
- [RNGDet: Road Network Graph Detection by Transformer in Aerial Images](https://mlsanity.com/paper/2202.07824/) (2022)
- [RNGDet++: Road Network Graph Detection by Transformer with Instance Segmentation and Multi-scale Features Enhancement](https://mlsanity.com/paper/2209.10150/) (2022)
- [Learning and Aggregating Lane Graphs for Urban Automated Driving](https://mlsanity.com/paper/2302.06175/) (2023)
- [TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving](https://mlsanity.com/paper/2505.17771/) (2025)
- [SkipcrossNets: Adaptive Skip-cross Fusion for Road Detection](https://mlsanity.com/paper/2308.12863/) (2023)
- [URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments](https://mlsanity.com/paper/2309.08814/) (2023)
- [SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Images](https://mlsanity.com/paper/2403.01381/) (2024)
- [Mastering Spatial Graph Prediction of Road Networks](https://mlsanity.com/paper/2210.00828/) (2022)
- [Leveraging GNSS and Onboard Visual Data from Consumer Vehicles for Robust Road Network Estimation](https://mlsanity.com/paper/2408.01640/) (2024)
- [PathMamba: A Hybrid Mamba-Transformer for Topologically Coherent Road Segmentation in Satellite Imagery](https://mlsanity.com/paper/2511.21298/) (2025)
- [Building and Road Segmentation Using EffUNet and Transfer Learning Approach](https://mlsanity.com/paper/2307.03980/) (2023)
- [Self-Supervised Pretraining for Aerial Road Extraction](https://mlsanity.com/paper/2503.24326/) (2025)
- [LineGraph2Road: Structural Graph Reasoning on Line Graphs for Road Network Extraction](https://mlsanity.com/paper/2602.23290/) (2026)

## Abstract (arXiv)

Road extraction is an essential step in building autonomous navigation systems. Detecting road segments is challenging as they are of varying widths, bifurcated throughout the image, and are often occluded by terrain, cloud, or other weather conditions. Using just convolution neural networks (ConvNets) for this problem is not effective as it is inefficient at capturing distant dependencies between road segments in the image which is essential to extract road connectivity. To this end, we propose a Spatial and Interaction Space Graph Reasoning (SPIN) module which when plugged into a ConvNet performs reasoning over graphs constructed on spatial and interaction spaces projected from the feature maps. Reasoning over spatial space extracts dependencies between different spatial regions and other contextual information. Reasoning over a projected interaction space helps in appropriate delineation of roads from other topographies present in the image. Thus, SPIN extracts long-range dependencies between road segments and effectively delineates roads from other semantics. We also introduce a SPIN pyramid which performs SPIN graph reasoning across multiple scales to extract multi-scale features. We propose a network based on stacked hourglass modules and SPIN pyramid for road segmentation which achieves better performance compared to existing methods. Moreover, our method is computationally efficient and significantly boosts the convergence speed during training, making it feasible for applying on large-scale high-resolution aerial images. Code available at: https://github.com/wgcban/SPIN_RoadMapper.git.
