AID4AD: Aerial Image Data for Automated Driving Perception
Not on the map. Why?
Abstract (arXiv)
This work investigates the integration of spatially aligned aerial imagery into perception tasks for automated vehicles (AVs). As a central contribution, we present AID4AD, a publicly available dataset that augments the nuScenes dataset with high-resolution aerial imagery precisely aligned to its local coordinate system. The alignment is performed using SLAM-based point cloud maps provided by nuScenes, establishing a direct link between aerial data and nuScenes local coordinate system. To ensure spatial fidelity, we propose an alignment workflow that corrects for localization and projection distortions. A manual quality control process further refines the dataset by identifying a set of high-quality alignments, which we publish as ground truth to support future research on automated registration. We demonstrate the practical value of AID4AD in two representative tasks: in online map construction, aerial imagery serves as a complementary input that improves the mapping process; in motion prediction, it functions as a structured environmental representation that replaces high-definition maps. Experiments show that aerial imagery leads to a 15-23% improvement in map construction accuracy and a 2% gain in trajectory prediction performance. These results highlight the potential of aerial imagery as a scalable and adaptable source of environmental context in automated vehicle systems, particularly in scenarios where high-definition maps are unavailable, outdated, or costly to maintain. AID4AD, along with evaluation code and pretrained models, is publicly released to foster further research in this direction: https://github.com/DriverlessMobility/AID4AD.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 4 Aug 2025.
Builds on
19 of 38 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
7 more
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 156
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 33
- 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
- 2023Building Lane-Level Maps from Aerial Imagescited by 13
- 2024OpenSatMap: A Fine-grained High-resolution Satellite Dataset for Large-scale Map Constructioncited by 11
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025SATMapTR: Satellite Image Enhanced Online HD Map Constructioncited by 1
- 2026Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Constructioncited by 1
- 2026AerialFusionMapNet: Online HD Map Construction with Aerial-Onboard BEV Fusioncited by 1
- 2026HRDX: A Large-Scale Vector HD-Map Datasetcited by 0
- 2026AerialFusionMapNet: Online HD Map Construction with Aerial-Onboard BEV Fusion23 Jun 2026
- 2026HRDX: A Large-Scale Vector HD-Map Dataset11 Jun 2026
- 2026Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Construction12 May 2026
- 2025SATMapTR: Satellite Image Enhanced Online HD Map Construction12 Dec 2025