Neural Turtle Graphics for Modeling City Road Layouts
Not on the map. Why?
Abstract (arXiv)
We propose Neural Turtle Graphics (NTG), a novel generative model for spatial graphs, and demonstrate its applications in modeling city road layouts. Specifically, we represent the road layout using a graph where nodes in the graph represent control points and edges in the graph represent road segments. NTG is a sequential generative model parameterized by a neural network. It iteratively generates a new node and an edge connecting to an existing node conditioned on the current graph. We train NTG on Open Street Map data and show that it outperforms existing approaches using a set of diverse performance metrics. Moreover, our method allows users to control styles of generated road layouts mimicking existing cities as well as to sketch parts of the city road layout to be synthesized. In addition to synthesis, the proposed NTG finds uses in an analytical task of aerial road parsing. Experimental results show that it achieves state-of-the-art performance on the SpaceNet dataset.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 4; 2023: 6; 2024: 3; 2025: 4; 2026: 1.
29 papers.
Sort:
By area:
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
- 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Trafficcited by 27
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
- 2023SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generationcited by 26
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
- 2021Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Drivingcited by 15
- 2021House-GAN++: Generative Adversarial Layout Refinement Networkscited by 13
17 more
- 2021Graph Representation Learning for Road Type Classificationcited by 8
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2021Beyond Road Extraction: A Dataset for Map Update using Aerial Imagescited by 5
- 2022GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Modelscited by 5
- 2021YOLinO: Generic Single Shot Polyline Detection in Real Timecited by 4
- 2021Updating Street Maps using Changes Detected in Satellite Imagerycited by 3
- 2023AutoEncoding Tree for City Generation and Applicationscited by 3
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observationcited by 3
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2021Exact Recovery of Community Structures Using DeepWalk and Node2veccited by 2
- 2022Large-Scale Auto-Regressive Modeling Of Street Networkscited by 2
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generationcited by 2
- 2025A Concise Survey on Lane Topology Reasoning for HD Mappingcited by 2
- 2022Mastering Spatial Graph Prediction of Road Networkscited by 1
- 2026ControlMap: Controllable High-Definition Map Generation for Traffic Scenario Simulationcited by 1
- 2021GANs for Urban Designcited by 0
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extractioncited by 0
- 2026ControlMap: Controllable High-Definition Map Generation for Traffic Scenario Simulation14 Jun 2026
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extraction25 Nov 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025A Concise Survey on Lane Topology Reasoning for HD Mapping31 Mar 2025
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments28 Mar 2025
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observation5 Nov 2024
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generation10 Jul 2024
- 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic26 Mar 2024
- 2023CityGen: Infinite and Controllable City Layout Generation3 Dec 2023
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoning10 Oct 2023
- 2023AutoEncoding Tree for City Generation and Applications27 Sep 2023
- 2023SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generation4 Jul 2023
17 more
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Construction15 Mar 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Models28 Nov 2022
- 2022Mastering Spatial Graph Prediction of Road Networks3 Oct 2022
- 2022Large-Scale Auto-Regressive Modeling Of Street Networks1 Sep 2022
- 2022Relationformer: A Unified Framework for Image-to-Graph Generation19 Mar 2022
- 2021Updating Street Maps using Changes Detected in Satellite Imagery13 Oct 2021
- 2021Beyond Road Extraction: A Dataset for Map Update using Aerial Images10 Oct 2021
- 2021Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving3 Sep 2021
- 2021Graph Representation Learning for Road Type Classification16 Jul 2021
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps28 Jun 2021
- 2021GANs for Urban Design4 May 2021
- 2021Lane Graph Estimation for Scene Understanding in Urban Driving1 May 2021
- 2021YOLinO: Generic Single Shot Polyline Detection in Real Time26 Mar 2021
- 2021Multimodal Motion Prediction with Stacked Transformers22 Mar 2021
- 2021House-GAN++: Generative Adversarial Layout Refinement Networks3 Mar 2021
- 2021Exact Recovery of Community Structures Using DeepWalk and Node2vec18 Jan 2021
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
- 2023SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generationcited by 26
- 2026ControlMap: Controllable High-Definition Map Generation for Traffic Scenario Simulationcited by 1
- 2026ControlMap: Controllable High-Definition Map Generation for Traffic Scenario Simulation14 Jun 2026
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments28 Mar 2025
- 2023SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generation4 Jul 2023
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
- 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Trafficcited by 27
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2021Lane Graph Estimation for Scene Understanding in Urban Drivingcited by 18
- 2021Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Drivingcited by 15
- 2021House-GAN++: Generative Adversarial Layout Refinement Networkscited by 13
- 2021Graph Representation Learning for Road Type Classificationcited by 8
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
12 most cited of 26 All 26 (JSON)
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extraction25 Nov 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025A Concise Survey on Lane Topology Reasoning for HD Mapping31 Mar 2025
- 2024Beyond Grid Data: Exploring Graph Neural Networks for Earth Observation5 Nov 2024
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generation10 Jul 2024
- 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic26 Mar 2024
- 2023CityGen: Infinite and Controllable City Layout Generation3 Dec 2023
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoning10 Oct 2023
- 2023AutoEncoding Tree for City Generation and Applications27 Sep 2023
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Construction15 Mar 2023
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Images10 Jan 2023
- 2022GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Models28 Nov 2022
12 newest of 26 All 26 (JSON)