The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersections
Not on the map. Why?
Abstract (arXiv)
Automated vehicles rely heavily on data-driven methods, especially for complex urban environments. Large datasets of real world measurement data in the form of road user trajectories are crucial for several tasks like road user prediction models or scenario-based safety validation. So far, though, this demand is unmet as no public dataset of urban road user trajectories is available in an appropriate size, quality and variety. By contrast, the highway drone dataset (highD) has recently shown that drones are an efficient method for acquiring naturalistic road user trajectories. Compared to driving studies or ground-level infrastructure sensors, one major advantage of using a drone is the possibility to record naturalistic behavior, as road users do not notice measurements taking place. Due to the ideal viewing angle, an entire intersection scenario can be measured with significantly less occlusion than with sensors at ground level. Both the class and the trajectory of each road user can be extracted from the video recordings with high precision using state-of-the-art deep neural networks. Therefore, we propose the creation of a comprehensive, large-scale urban intersection dataset with naturalistic road user behavior using camera-equipped drones as successor of the highD dataset. The resulting dataset contains more than 11500 road users including vehicles, bicyclists and pedestrians at intersections in Germany and is called inD. The dataset consists of 10 hours of measurement data from four intersections and is available online for non-commercial research at: http://www.inD-dataset.com
Key facts. Cited by 137 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 23; 2023: 25; 2024: 30; 2025: 27; 2026: 20.
137 papers.
Sort:
By area:
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 52
- 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Researchcited by 40
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2022SIND: A Drone Dataset at Signalized Intersection in Chinacited by 30
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
38 more
- 2023I-24 MOTION: An instrument for freeway traffic sciencecited by 26
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUscited by 16
- 2021Decision-Making Technology for Autonomous Vehicles Learning-Based Methods, Applications and Future Outlookcited by 14
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Reviewcited by 13
- 2021Towards Traffic Scene Description: The Semantic Scene Graphcited by 12
- 2022Using Ontologies for the Formalization and Recognition of Criticality for Automated Drivingcited by 12
- 2022Uncertainty estimation of pedestrian future trajectory using Bayesian approximationcited by 12
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
- 2022Cooperative Behavior Planning for Automated Driving using Graph Neural Networkscited by 10
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lightscited by 10
- 2024A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challengescited by 10
- 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Modelscited by 10
- 2021Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Informationcited by 9
- 2021Self-Supervised Action-Space Prediction for Automated Drivingcited by 9
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2023Car-Following Models: A Multidisciplinary Reviewcited by 8
- 2024Analysis of a Modular Autonomous Driving Architecture: The Top Submission to CARLA Leaderboard 2.0 Challengecited by 8
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarkingcited by 8
- 2022Verifiable Goal Recognition for Autonomous Driving with Occlusionscited by 7
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videoscited by 7
- 2023Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervisioncited by 7
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
- 2024Disentangled Neural Relational Inference for Interpretable Motion Predictioncited by 7
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarioscited by 7
- 2025Highly Accurate and Diverse Traffic Data: The DeepScenario Open 3D Datasetcited by 7
- 2021End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learningcited by 6
- 2022Vehicle Trajectory Prediction on Highways Using Bird Eye View Representations and Deep Learningcited by 6
- 2024Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Plannercited by 6
- 2025PDB: Not All Drivers Are the Same -- A Personalized Dataset for Understanding Driving Behaviorcited by 6
- 2022T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Predictioncited by 5
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2023Tactics2D: A Highly Modular and Extensible Simulator for Driving Decision-makingcited by 5
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
50 most cited of 137 All 137 (JSON)
- 2026Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds30 Sep 2026
- 2026Choose Your Game Wisely: Measuring Game-Theoretic Structures in Real-World Vehicle Interactions26 Aug 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026RoadWeaver: Large-Scale Lane-Level HD Map Generation from Scratch for Autonomous Driving Simulation12 Aug 2026
- 2026How Roadside Units Enhance Intersection Safety? Cooperative Autonomous Driving System Design and A Proof of Concept10 Aug 2026
- 2026LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras22 Jul 2026
- 2026INTENT: An LSTM Framework for Vehicle Intention Prediction in Intersection Scenarios with Comprehensive Ablation Analysis9 Jul 2026
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving8 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving31 May 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction18 May 2026
38 more
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models24 Feb 2026
- 2026Interacting safely with cyclists using Hamilton-Jacobi reachability and reinforcement learning20 Feb 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2026HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic3 Feb 2026
- 2026Measuring the State of Open Science in Transportation Using Large Language Models20 Jan 2026
- 2026CARLA-Round: A Multi-Factor Simulation Dataset for Roundabout Trajectory Prediction17 Jan 2026
- 2026DeepUrban: Interaction-Aware Trajectory Prediction and Planning for Automated Driving by Aerial Imagery15 Jan 2026
- 2025Learning from Risk: LLM-Guided Generation of Safety-Critical Scenarios with Prior Knowledge25 Nov 2025
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles30 Oct 2025
- 2025Digital Twin-based Cooperative Autonomous Driving in Smart Intersections: A Multi-Agent Reinforcement Learning Approach18 Sep 2025
- 2025STEP: Structured Training and Evaluation Platform for benchmarking trajectory prediction models18 Sep 2025
- 2025FLUID: A Fine-Grained Lightweight Urban Signalized-Intersection Dataset of Dense Conflict Trajectories30 Aug 2025
- 2025Object Recognition Datasets and Challenges: A Review30 Jul 2025
- 2025Improving AEBS Validation Through Objective Intervention Classification Leveraging the Prediction Divergence Principle10 Jul 2025
- 2025Mode Collapse Happens: Evaluating Critical Interactions in Joint Trajectory Prediction Models29 Jun 2025
- 2025Generalizable Trajectory Prediction via Inverse Reinforcement Learning with Mamba-Graph Architecture14 Jun 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Towards Predicting Any Human Trajectory In Context1 Jun 2025
- 2025PPTNet: A Hybrid Periodic Pattern-Transformer Architecture for Traffic Flow Prediction and Congestion Identification19 May 2025
- 2025Multi-Agent Reinforcement Learning-based Cooperative Autonomous Driving in Smart Intersections7 May 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2025Highly Accurate and Diverse Traffic Data: The DeepScenario Open 3D Dataset24 Apr 2025
- 2025DRIFT open dataset: A drone-derived intelligence for traffic analysis in urban environment15 Apr 2025
- 2025OnSiteVRU: A High-Resolution Trajectory Dataset for High-Density Vulnerable Road Users30 Mar 2025
- 2025ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset24 Mar 2025
- 2025Generating Causal Explanations of Vehicular Agent Behavioural Interactions with Learnt Reward Profiles18 Mar 2025
- 2025MonoCT: Overcoming Monocular 3D Detection Domain Shift with Consistent Teacher Models17 Mar 2025
- 2025A Framework for a Capability-driven Evaluation of Scenario Understanding for Multimodal Large Language Models in Autonomous Driving14 Mar 2025
- 2025PDB: Not All Drivers Are the Same -- A Personalized Dataset for Understanding Driving Behavior9 Mar 2025
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
- 2025Characterizing Structured versus Unstructured Environments based on Pedestrians' and Vehicles' Motion Trajectories24 Feb 2025
- 2025TrajFlow: A Generative Framework for Occupancy Density Estimation Using Normalizing Flows24 Jan 2025
- 2025Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Framework10 Jan 2025
- 2024Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Planner24 Dec 2024
- 2024Traffic-Rule-Compliant Trajectory Repair via Satisfiability Modulo Theories and Reachability Analysis20 Dec 2024
- 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Models17 Dec 2024
50 newest of 137 All 137 (JSON)
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
- 2022Cooperative Behavior Planning for Automated Driving using Graph Neural Networkscited by 10
- 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Modelscited by 10
- 2024Analysis of a Modular Autonomous Driving Architecture: The Top Submission to CARLA Leaderboard 2.0 Challengecited by 8
- 2024Augmenting Safety-Critical Driving Scenarios while Preserving Similarity to Expert Trajectoriescited by 3
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous drivingcited by 3
- 2024Mitigating Metropolitan Carbon Emissions with Dynamic Eco-driving at Scalecited by 2
- 2025Multi-Agent Reinforcement Learning-based Cooperative Autonomous Driving in Smart Intersectionscited by 2
- 2025Digital Twin-based Cooperative Autonomous Driving in Smart Intersections: A Multi-Agent Reinforcement Learning Approachcited by 1
- 2026RoadWeaver: Large-Scale Lane-Level HD Map Generation from Scratch for Autonomous Driving Simulationcited by 1
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Drivingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026RoadWeaver: Large-Scale Lane-Level HD Map Generation from Scratch for Autonomous Driving Simulation12 Aug 2026
- 2026How Roadside Units Enhance Intersection Safety? Cooperative Autonomous Driving System Design and A Proof of Concept10 Aug 2026
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving8 Jul 2026
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving31 May 2026
- 2025Digital Twin-based Cooperative Autonomous Driving in Smart Intersections: A Multi-Agent Reinforcement Learning Approach18 Sep 2025
- 2025Multi-Agent Reinforcement Learning-based Cooperative Autonomous Driving in Smart Intersections7 May 2025
- 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Models17 Dec 2024
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
- 2024Mitigating Metropolitan Carbon Emissions with Dynamic Eco-driving at Scale10 Aug 2024
- 2024Augmenting Safety-Critical Driving Scenarios while Preserving Similarity to Expert Trajectories20 Apr 2024
- 2024Analysis of a Modular Autonomous Driving Architecture: The Top Submission to CARLA Leaderboard 2.0 Challenge21 Mar 2024
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous driving7 Mar 2024
12 newest of 13 All 13 (JSON)
- 2024A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challengescited by 10
- 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environmentscited by 3
- 2026Interacting safely with cyclists using Hamilton-Jacobi reachability and reinforcement learningcited by 0
- 2026Interacting safely with cyclists using Hamilton-Jacobi reachability and reinforcement learning20 Feb 2026
- 2024A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challenges11 Sep 2024
- 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environments22 Jul 2024
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Predictioncited by 3
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Modelscited by 3
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models24 Feb 2026
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction25 Nov 2023
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 52
- 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Researchcited by 40
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2022SIND: A Drone Dataset at Signalized Intersection in Chinacited by 30
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2023I-24 MOTION: An instrument for freeway traffic sciencecited by 26
12 most cited of 114 All 114 (JSON)
- 2026Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds30 Sep 2026
- 2026Choose Your Game Wisely: Measuring Game-Theoretic Structures in Real-World Vehicle Interactions26 Aug 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras22 Jul 2026
- 2026INTENT: An LSTM Framework for Vehicle Intention Prediction in Intersection Scenarios with Comprehensive Ablation Analysis9 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction18 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026DD-MDN: Human Trajectory Forecasting with Diffusion-Based Dual Mixture Density Networks and Uncertainty Self-Calibration11 Feb 2026
- 2026HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic3 Feb 2026
- 2026Measuring the State of Open Science in Transportation Using Large Language Models20 Jan 2026
12 newest of 114 All 114 (JSON)