CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos
Not on the map. Why?
Abstract (arXiv)
Road traffic scene reconstruction from videos has been desirable by road safety regulators, city planners, researchers, and autonomous driving technology developers. However, it is expensive and unnecessary to cover every mile of the road with cameras mounted on the road infrastructure. This paper presents a method that can process aerial videos to vehicle trajectory data so that a traffic scene can be automatically reconstructed and accurately re-simulated using computers. On average, the vehicle localization error is about 0.1 m to 0.3 m using a consumer-grade drone flying at 120 meters. This project also compiles a dataset of 50 reconstructed road traffic scenes from about 100 hours of aerial videos to enable various downstream traffic analysis applications and facilitate further road traffic related research. The dataset is available at https://github.com/duolu/CAROM.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 62 references that are in the map. First posted on arXiv 31 May 2023.
Builds on
19 of 62 references.
References · 19
- 2017Mask R-CNNcited by 7,277
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 277
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2020RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Drivingcited by 150
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2014Viewpoints and Keypointscited by 59
- 2021OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Associationcited by 55
7 more
- 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
- 2019A Dual-Path Model With Adaptive Attention For Vehicle Re-Identificationcited by 34
- 2020openDD: A Large-Scale Roundabout Drone Datasetcited by 29
- 2019Providentia -- A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluationcited by 17
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2021CAROM -- Vehicle Localization and Traffic Scene Reconstruction from Monocular Cameras on Road Infrastructurescited by 5
- 2020Optimized tour planning for drone-based urban traffic monitoringcited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 2.
7 papers.
- 2024eTraM: Event-based Traffic Monitoring Datasetcited by 24
- 2023RiskBench: A Scenario-based Benchmark for Risk Identificationcited by 12
- 2025MC-BEVRO: Multi-Camera Bird Eye View Road Occupancy Detection for Traffic Monitoringcited by 2
- 2025ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Datasetcited by 2
- 2023SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Camerascited by 1
- 2024Roundabout Dilemma Zone Data Mining and Forecasting with Trajectory Prediction and Graph Neural Networkscited by 0
- 2024Querying Perception Streams with Spatial Regular Expressionscited by 0
- 2025ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset24 Mar 2025
- 2025MC-BEVRO: Multi-Camera Bird Eye View Road Occupancy Detection for Traffic Monitoring16 Feb 2025
- 2024Querying Perception Streams with Spatial Regular Expressions8 Nov 2024
- 2024Roundabout Dilemma Zone Data Mining and Forecasting with Trajectory Prediction and Graph Neural Networks1 Sep 2024
- 2024eTraM: Event-based Traffic Monitoring Dataset29 Mar 2024
- 2023RiskBench: A Scenario-based Benchmark for Risk Identification4 Dec 2023
- 2023SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Cameras4 Sep 2023