INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps
Not on the map. Why?
Cited by 37 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Behavior-related research areas such as motion prediction/planning, representation/imitation learning, behavior modeling/generation, and algorithm testing, require support from high-quality motion datasets containing interactive driving scenarios with different driving cultures. In this paper, we present an INTERnational, Adversarial and Cooperative moTION dataset (INTERACTION dataset) in interactive driving scenarios with semantic maps. Five features of the dataset are highlighted. 1) The interactive driving scenarios are diverse, including urban/highway/ramp merging and lane changes, roundabouts with yield/stop signs, signalized intersections, intersections with one/two/all-way stops, etc. 2) Motion data from different countries and different continents are collected so that driving preferences and styles in different cultures are naturally included. 3) The driving behavior is highly interactive and complex with adversarial and cooperative motions of various traffic participants. Highly complex behavior such as negotiations, aggressive/irrational decisions and traffic rule violations are densely contained in the dataset, while regular behavior can also be found from cautious car-following, stop, left/right/U-turn to rational lane-change and cycling and pedestrian crossing, etc. 4) The levels of criticality span wide, from regular safe operations to dangerous, near-collision maneuvers. Real collision, although relatively slight, is also included. 5) Maps with complete semantic information are provided with physical layers, reference lines, lanelet connections and traffic rules. The data is recorded from drones and traffic cameras. Statistics of the dataset in terms of number of entities and interaction density are also provided, along with some utilization examples in a variety of behavior-related research areas. The dataset can be downloaded via https://interaction-dataset.com.
Key facts. Cited by 231 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 30; 2022: 41; 2023: 53; 2024: 36; 2025: 42; 2026: 27.
231 papers.
Sort:
By area:
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 124
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
38 more
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2022FJMP: Factorized Joint Multi-Agent Motion Prediction over Learned Directed Acyclic Interaction Graphscited by 41
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 39
- 2024HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attentioncited by 37
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2020Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Drivingcited by 34
- 2021Imagining The Road Ahead: Multi-Agent Trajectory Prediction via Differentiable Simulationcited by 32
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
- 2021PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulationcited by 29
- 2022SIND: A Drone Dataset at Signalized Intersection in Chinacited by 29
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasetscited by 25
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Modelcited by 25
- 2021Diverse Auto-Curriculum is Critical for Successful Real-World Multiagent Learning Systemscited by 24
- 2023I-24 MOTION: An instrument for freeway traffic sciencecited by 24
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Futurecited by 22
- 2024Adapting to Length Shift: FlexiLength Network for Trajectory Predictioncited by 22
- 2023Learning Cooperative Trajectory Representations for Motion Forecastingcited by 21
- 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2021Injecting Knowledge in Data-driven Vehicle Trajectory Predictorscited by 18
- 2021Differentiable Particle Filtering without Modifying the Forward Passcited by 18
50 most cited of 231 All 231 (JSON)
- 2026Choose Your Game Wisely: Measuring Game-Theoretic Structures in Real-World Vehicle Interactions26 Aug 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026RoadWeaver: Large-Scale Lane-Level HD Map Generation from Scratch for Autonomous Driving Simulation12 Aug 2026
- 2026When Shared Rollouts Fail in Defensive Driving Evaluation: A NAVSIM Score Basis Audit5 Aug 2026
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Integration Matters: Rollout-Based Training for Constrained Diffusion Models15 Jul 2026
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving8 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Mind the Noise: Sensitivity of Transformer-based Interaction-Aware Trajectory Prediction Models to Noisy Data19 Jun 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
38 more
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction14 Apr 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026Future-Interactions-Aware Trajectory Prediction via Braid Theory23 Mar 2026
- 2026Eye Gaze-Informed and Context-Aware Pedestrian Trajectory Prediction in Shared Spaces with Automated Shuttles: A Virtual Reality Study20 Mar 2026
- 2026MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updating10 Mar 2026
- 2026Fusing Driver Perceived and Physical Risk for Safety Critical Scenario Screening in Autonomous Driving7 Mar 2026
- 2026Improved Constrained Generation by Bridging Pretrained Generative Models6 Mar 2026
- 2026ScenicRules: An Autonomous Driving Benchmark with Multi-Objective Specifications and Abstract Scenarios17 Feb 2026
- 2026RoadscapesQA: A Multitask, Multimodal Dataset for Visual Question Answering on Indian Roads13 Feb 2026
- 2026HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic3 Feb 2026
- 2026From Observation to Prediction: LSTM for Vehicle Lane Change Forecasting on Highway On/Off-Ramps21 Jan 2026
- 2026DeepUrban: Interaction-Aware Trajectory Prediction and Planning for Automated Driving by Aerial Imagery15 Jan 2026
- 2025Toward Efficient and Robust Behavior Models for Multi-Agent Driving Simulation5 Dec 2025
- 2025SocialDriveGen: Generating Diverse Traffic Scenarios with Controllable Social Interactions1 Dec 2025
- 2025Multi-Agent Scenario Generation in Roundabouts with a Transformer-enhanced Conditional Variational Autoencoder28 Oct 2025
- 2025CAMNet: Leveraging Cooperative Awareness Messages for Vehicle Trajectory Prediction14 Oct 2025
- 2025STEP: Structured Training and Evaluation Platform for benchmarking trajectory prediction models18 Sep 2025
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction17 Sep 2025
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2025ProgD: Progressive Multi-scale Decoding with Dynamic Graphs for Joint Multi-agent Motion Forecasting11 Sep 2025
- 2025FLUID: A Fine-Grained Lightweight Urban Signalized-Intersection Dataset of Dense Conflict Trajectories30 Aug 2025
- 2025Complementary Learning System Empowers Online Continual Learning of Vehicle Motion Forecasting in Smart Cities27 Aug 2025
- 2025Adaptive Output Steps: FlexiSteps Network for Dynamic Trajectory Prediction25 Aug 2025
- 2025LLM-based Human-like Traffic Simulation for Self-driving Tests23 Aug 2025
- 2025Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey11 Aug 2025
- 2025H2C: Hippocampal Circuit-inspired Continual Learning for Lifelong Trajectory Prediction in Autonomous Driving2 Aug 2025
- 2025Object Recognition Datasets and Challenges: A Review30 Jul 2025
- 2025Stochastic Optimal Control via Measure Relaxations26 Jul 2025
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture9 Jul 2025
- 2025Improving Consistency in Vehicle Trajectory Prediction Through Preference Optimization3 Jul 2025
- 2025A New Perspective On AI Safety Through Control Theory Methodologies30 Jun 2025
- 2025Deep Fictitious Play-Based Potential Differential Games for Learning Human-Like Interaction at Unsignalized Intersections14 Jun 2025
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis13 Jun 2025
- 2025Trajectory Prediction Meets Large Language Models: A Survey3 Jun 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
50 newest of 231 All 231 (JSON)
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 124
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2024Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priorscited by 15
- 2025Collaborative Perception Datasets for Autonomous Driving: A Reviewcited by 8
12 most cited of 35 All 35 (JSON)
- 2026RoadWeaver: Large-Scale Lane-Level HD Map Generation from Scratch for Autonomous Driving Simulation12 Aug 2026
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving8 Jul 2026
- 2025Toward Efficient and Robust Behavior Models for Multi-Agent Driving Simulation5 Dec 2025
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2025LLM-based Human-like Traffic Simulation for Self-driving Tests23 Aug 2025
- 2025Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey11 Aug 2025
- 2025Deep Fictitious Play-Based Potential Differential Games for Learning Human-Like Interaction at Unsignalized Intersections14 Jun 2025
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis13 Jun 2025
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunities13 May 2025
- 2025Socially-Aware Autonomous Driving: Inferring Yielding Intentions for Safer Interactions28 Apr 2025
- 2025Collaborative Perception Datasets for Autonomous Driving: A Review17 Apr 2025
12 newest of 35 All 35 (JSON)
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Modelcited by 25
- 2025Dream to Drive with Predictive Individual World Modelcited by 11
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2025Dream to Drive with Predictive Individual World Model28 Jan 2025
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model14 Oct 2024
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectories15 Jun 2021
- 2020Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Drivingcited by 34
- 2023Residual Q-Learning: Offline and Online Policy Customization without Valuecited by 9
- 2020Causal Transfer for Imitation Learning and Decision Making under Sensor-shiftcited by 8
- 2025Learning to Drive by Imitating Surrounding Vehiclescited by 0
- 2025Learning to Drive by Imitating Surrounding Vehicles8 Mar 2025
- 2023Residual Q-Learning: Offline and Online Policy Customization without Value15 Jun 2023
- 2020Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Driving22 Jun 2020
- 2020Causal Transfer for Imitation Learning and Decision Making under Sensor-shift2 Mar 2020
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2024Driving Style Alignment for LLM-powered Driver Agentcited by 15
- 2024Driving Style Alignment for LLM-powered Driver Agent17 Mar 2024
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modeling28 Sep 2023
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
12 most cited of 179 All 179 (JSON)
- 2026Choose Your Game Wisely: Measuring Game-Theoretic Structures in Real-World Vehicle Interactions26 Aug 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026When Shared Rollouts Fail in Defensive Driving Evaluation: A NAVSIM Score Basis Audit5 Aug 2026
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Mind the Noise: Sensitivity of Transformer-based Interaction-Aware Trajectory Prediction Models to Noisy Data19 Jun 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction14 Apr 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
12 newest of 179 All 179 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026An interactive enhanced driving dataset for autonomous driving
- 2025Generative Modeling for Adversarial Lane-Change Scenarios ↗
- 2024WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving
- 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems
- 2023Utilizing Hybrid Trajectory Prediction Models to Recognize Highly Interactive Traffic Scenarios ↗
- 2026Aligning Microscopic Vehicle and Macroscopic Traffic Statistics: Reconstructing Driving Behavior from Partial Data
- 2024CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models