Segment Anything Model for Road Network Graph Extraction
Not on the map. Why?
Abstract (arXiv)
We propose SAM-Road, an adaptation of the Segment Anything Model (SAM) for extracting large-scale, vectorized road network graphs from satellite imagery. To predict graph geometry, we formulate it as a dense semantic segmentation task, leveraging the inherent strengths of SAM. The image encoder of SAM is fine-tuned to produce probability masks for roads and intersections, from which the graph vertices are extracted via simple non-maximum suppression. To predict graph topology, we designed a lightweight transformer-based graph neural network, which leverages the SAM image embeddings to estimate the edge existence probabilities between vertices. Our approach directly predicts the graph vertices and edges for large regions without expensive and complex post-processing heuristics, and is capable of building complete road network graphs spanning multiple square kilometers in a matter of seconds. With its simple, straightforward, and minimalist design, SAM-Road achieves comparable accuracy with the state-of-the-art method RNGDet++, while being 40 times faster on the City-scale dataset. We thus demonstrate the power of a foundational vision model when applied to a graph learning task. The code is available at https://github.com/htcr/sam_road.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 46 of its 71 references that are in the map. First posted on arXiv 24 Mar 2024.
Builds on
46 of 71 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
34 more
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2023PaLM 2 Technical Reportcited by 1,162
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2017Deep Layer Aggregationcited by 436
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2021Remote Sensing Image Change Detection with Transformerscited by 306
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2018Adaptive Graph Convolutional Neural Networkscited by 155
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 96
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
- 2017Region-based Quality Estimation Network for Large-scale Person Re-identificationcited by 33
- 2022RNGDet: Road Network Graph Detection by Transformer in Aerial Imagescited by 26
- 2021Unconditional Scene Graph Generationcited by 22
- 2017Impression Network for Video Object Detectioncited by 13
- 2024Multi-Person 3D Pose Estimation from Multi-View Uncalibrated Depth Camerascited by 6
- 2019Estimating 3D Camera Pose from 2D Pedestrian Trajectoriescited by 3
Built on by
Citing papers per year: 2024: 5; 2025: 14; 2026: 9.
28 papers.
Sort:
By area:
- 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agentcited by 49
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Modelscited by 29
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Methodcited by 10
- 2025UrbanSAM: Learning Invariance-Inspired Adapters for Segment Anything Models in Urban Constructioncited by 8
- 2025IRSAMap:Towards Large-Scale, High-Resolution Land Cover Map Vectorizationcited by 5
- 2025From Ideal to Real: Unified and Data-Efficient Dense Prediction for Real-World Scenarioscited by 3
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphscited by 2
- 2025GLD-Road:A global-local decoding road network extraction model for remote sensing imagescited by 2
- 2025DIGMAPPER: A Modular System for Automated Geologic Map Digitizationcited by 2
- 2025LayoutGKN: Graph Similarity Learning of Floor Planscited by 2
- 2026Flood Mapping from RGB imagery using a Vision Foundation Modelcited by 2
16 more
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitivecited by 2
- 2025InterLoc: LiDAR-based Intersection Localization using Road Segmentation with Automated Evaluation Methodcited by 1
- 2025Bridging the Gap Between Sparsity and Redundancy: A Dual-Decoding Framework with Global Context for Map Inferencecited by 1
- 2025UniVector: Unified Vector Extraction via Instance-Geometry Interactioncited by 1
- 2024EucliDreamer: Fast and High-Quality Texturing for 3D Models with Depth-Conditioned Stable Diffusioncited by 0
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failurescited by 0
- 2025DeH4R: A Decoupled and Hybrid Method for Road Network Graph Extractioncited by 0
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extractioncited by 0
- 2025Beyond Endpoints: Path-Centric Reasoning for Vectorized Off-Road Network Extractioncited by 0
- 2026LineGraph2Road: Structural Graph Reasoning on Line Graphs for Road Network Extractioncited by 0
- 2026Laplacian Frequency Interaction Network for Rural Thematic Road Extractioncited by 0
- 2026Vector Map as Language: Toward Unified Remote Sensing Vector Mappingcited by 0
- 2026TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learningcited by 0
- 2026Distilled Roads: Generalisable Road Network Extraction Across Sensors, Resolutions, and Regioncited by 0
- 2026VisAdj: Learning Adjacency Matrices from Node-Link Imagescited by 0
- 2026Genesis: A Generative Engine for Hierarchical Satellite Image Synthesiscited by 0
- 2026Genesis: A Generative Engine for Hierarchical Satellite Image Synthesis2 Sep 2026
- 2026VisAdj: Learning Adjacency Matrices from Node-Link Images22 Aug 2026
- 2026Distilled Roads: Generalisable Road Network Extraction Across Sensors, Resolutions, and Region4 Aug 2026
- 2026TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learning20 Jul 2026
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026Flood Mapping from RGB imagery using a Vision Foundation Model23 Jun 2026
- 2026Vector Map as Language: Toward Unified Remote Sensing Vector Mapping9 Jun 2026
- 2026Laplacian Frequency Interaction Network for Rural Thematic Road Extraction4 May 2026
- 2026LineGraph2Road: Structural Graph Reasoning on Line Graphs for Road Network Extraction26 Feb 2026
- 2025Beyond Endpoints: Path-Centric Reasoning for Vectorized Off-Road Network Extraction11 Dec 2025
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extraction25 Nov 2025
- 2025UniVector: Unified Vector Extraction via Instance-Geometry Interaction15 Oct 2025
16 more
- 2025Bridging the Gap Between Sparsity and Redundancy: A Dual-Decoding Framework with Global Context for Map Inference15 Sep 2025
- 2025LayoutGKN: Graph Similarity Learning of Floor Plans3 Sep 2025
- 2025IRSAMap:Towards Large-Scale, High-Resolution Land Cover Map Vectorization22 Aug 2025
- 2025DeH4R: A Decoupled and Hybrid Method for Road Network Graph Extraction19 Aug 2025
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failures8 Aug 2025
- 2025From Ideal to Real: Unified and Data-Efficient Dense Prediction for Real-World Scenarios25 Jun 2025
- 2025DIGMAPPER: A Modular System for Automated Geologic Map Digitization19 Jun 2025
- 2025GLD-Road:A global-local decoding road network extraction model for remote sensing images11 Jun 2025
- 2025InterLoc: LiDAR-based Intersection Localization using Road Segmentation with Automated Evaluation Method1 May 2025
- 2025UrbanSAM: Learning Invariance-Inspired Adapters for Segment Anything Models in Urban Construction21 Feb 2025
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphs17 Feb 2025
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Method23 Nov 2024
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Models20 Nov 2024
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model27 Jun 2024
- 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun 2024
- 2024EucliDreamer: Fast and High-Quality Texturing for 3D Models with Depth-Conditioned Stable Diffusion16 Apr 2024
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Methodcited by 10
- 2025UrbanSAM: Learning Invariance-Inspired Adapters for Segment Anything Models in Urban Constructioncited by 8
- 2025IRSAMap:Towards Large-Scale, High-Resolution Land Cover Map Vectorizationcited by 5
- 2025From Ideal to Real: Unified and Data-Efficient Dense Prediction for Real-World Scenarioscited by 3
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphscited by 2
- 2025GLD-Road:A global-local decoding road network extraction model for remote sensing imagescited by 2
- 2025DIGMAPPER: A Modular System for Automated Geologic Map Digitizationcited by 2
- 2025LayoutGKN: Graph Similarity Learning of Floor Planscited by 2
- 2026Flood Mapping from RGB imagery using a Vision Foundation Modelcited by 2
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitivecited by 2
- 2025InterLoc: LiDAR-based Intersection Localization using Road Segmentation with Automated Evaluation Methodcited by 1
- 2025Bridging the Gap Between Sparsity and Redundancy: A Dual-Decoding Framework with Global Context for Map Inferencecited by 1
12 most cited of 24 All 24 (JSON)
- 2026Genesis: A Generative Engine for Hierarchical Satellite Image Synthesis2 Sep 2026
- 2026VisAdj: Learning Adjacency Matrices from Node-Link Images22 Aug 2026
- 2026Distilled Roads: Generalisable Road Network Extraction Across Sensors, Resolutions, and Region4 Aug 2026
- 2026TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learning20 Jul 2026
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026Flood Mapping from RGB imagery using a Vision Foundation Model23 Jun 2026
- 2026Vector Map as Language: Toward Unified Remote Sensing Vector Mapping9 Jun 2026
- 2026Laplacian Frequency Interaction Network for Rural Thematic Road Extraction4 May 2026
- 2026LineGraph2Road: Structural Graph Reasoning on Line Graphs for Road Network Extraction26 Feb 2026
- 2025Beyond Endpoints: Path-Centric Reasoning for Vectorized Off-Road Network Extraction11 Dec 2025
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extraction25 Nov 2025
- 2025UniVector: Unified Vector Extraction via Instance-Geometry Interaction15 Oct 2025
12 newest of 24 All 24 (JSON)