mlsanityData to 7 Oct 2026

INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps

arXiv 1910.03088 ↗First posted 30 Sep 2019cs.RO cs.CV cs.LGcited by 231

Not on the map. Why?

Cited by 37 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Behavior-related research areas such as motion prediction/planning, representation/imitation learning, behavior modeling/generation, and algorithm testing, require support from high-quality motion datasets containing interactive driving scenarios with different driving cultures. In this paper, we present an INTERnational, Adversarial and Cooperative moTION dataset (INTERACTION dataset) in interactive driving scenarios with semantic maps. Five features of the dataset are highlighted. 1) The interactive driving scenarios are diverse, including urban/highway/ramp merging and lane changes, roundabouts with yield/stop signs, signalized intersections, intersections with one/two/all-way stops, etc. 2) Motion data from different countries and different continents are collected so that driving preferences and styles in different cultures are naturally included. 3) The driving behavior is highly interactive and complex with adversarial and cooperative motions of various traffic participants. Highly complex behavior such as negotiations, aggressive/irrational decisions and traffic rule violations are densely contained in the dataset, while regular behavior can also be found from cautious car-following, stop, left/right/U-turn to rational lane-change and cycling and pedestrian crossing, etc. 4) The levels of criticality span wide, from regular safe operations to dangerous, near-collision maneuvers. Real collision, although relatively slight, is also included. 5) Maps with complete semantic information are provided with physical layers, reference lines, lanelet connections and traffic rules. The data is recorded from drones and traffic cameras. Statistics of the dataset in terms of number of entities and interaction density are also provided, along with some utilization examples in a variety of behavior-related research areas. The dataset can be downloaded via https://interaction-dataset.com.

Key facts. Cited by 231 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 2; 2021: 30; 2022: 41; 2023: 53; 2024: 36; 2025: 42; 2026: 27.

231 papers.

Sort:

By area:

  1. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  2. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  3. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  4. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  5. 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
  6. 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 124
  7. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
  8. 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
  9. 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
  10. 2023The Waymo Open Sim Agents Challengecited by 86
  11. 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
  12. 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
38 more
  1. 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
  2. 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
  3. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
  4. 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
  5. 2022CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscited by 43
  6. 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
  7. 2022FJMP: Factorized Joint Multi-Agent Motion Prediction over Learned Directed Acyclic Interaction Graphscited by 41
  8. 2022EarthNets: Empowering AI in Earth Observationcited by 40
  9. 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
  10. 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 39
  11. 2024HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attentioncited by 37
  12. 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
  13. 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
  14. 2020Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Drivingcited by 34
  15. 2021Imagining The Road Ahead: Multi-Agent Trajectory Prediction via Differentiable Simulationcited by 32
  16. 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
  17. 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
  18. 2021PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulationcited by 29
  19. 2022SIND: A Drone Dataset at Signalized Intersection in Chinacited by 29
  20. 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
  21. 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
  22. 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
  23. 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
  24. 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasetscited by 25
  25. 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Modelcited by 25
  26. 2021Diverse Auto-Curriculum is Critical for Successful Real-World Multiagent Learning Systemscited by 24
  27. 2023I-24 MOTION: An instrument for freeway traffic sciencecited by 24
  28. 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
  29. 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
  30. 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Futurecited by 22
  31. 2024Adapting to Length Shift: FlexiLength Network for Trajectory Predictioncited by 22
  32. 2023Learning Cooperative Trajectory Representations for Motion Forecastingcited by 21
  33. 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
  34. 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
  35. 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
  36. 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
  37. 2021Injecting Knowledge in Data-driven Vehicle Trajectory Predictorscited by 18
  38. 2021Differentiable Particle Filtering without Modifying the Forward Passcited by 18

50 most cited of 231 All 231 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026An interactive enhanced driving dataset for autonomous driving
  2. 2025Generative Modeling for Adversarial Lane-Change Scenarios ↗
  3. 2024WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving
  4. 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems
  5. 2023Utilizing Hybrid Trajectory Prediction Models to Recognize Highly Interactive Traffic Scenarios ↗
  6. 2026Aligning Microscopic Vehicle and Macroscopic Traffic Statistics: Reconstructing Driving Behavior from Partial Data
  7. 2024CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving
  8. 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models