EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Emirates Multi-Task (EMT) dataset, designed to support multi-task benchmarking within a unified framework. It comprises over 30,000 frames from a dash-camera perspective and 570,000 annotated bounding boxes, covering approximately 150 kilometers of driving routes that reflect the distinctive road topology, congestion patterns, and driving behavior of Gulf region traffic. The dataset supports three primary tasks: tracking, trajectory forecasting, and intention prediction. Each benchmark is accompanied by corresponding evaluations: (1) multi-agent tracking experiments addressing multi-class scenarios and occlusion handling; (2) trajectory forecasting evaluation using deep sequential and interaction-aware models; and (3) intention prediction experiments based on observed trajectories. The dataset is publicly available at https://avlab.io/emt-dataset, with pre-processing scripts and evaluation models at https://github.com/AV-Lab/emt-dataset.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 72 references that are in the map. First posted on arXiv 26 Feb 2025.
Builds on
53 of 72 references.
References · 53
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2019Tracking without bells and whistlescited by 382
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
38 more
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2018TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactionscited by 82
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2020Spatiotemporal Relationship Reasoning for Pedestrian Intent Predictioncited by 71
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2017Probabilistic Vehicle Trajectory Prediction over Occupancy Grid Map via Recurrent Neural Networkcited by 56
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2018How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Predictioncited by 46
- 2022Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Predictioncited by 36
- 2016Joint Attention in Autonomous Driving (JAAD)cited by 35
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2018Naturalistic Driver Intention and Path Prediction using Recurrent Neural Networkscited by 29
- 2022GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Modelcited by 25
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
- 2018Scene-LSTM: A Model for Human Trajectory Predictioncited by 24
- 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
- 2018MX-LSTM: mixing tracklets and vislets to jointly forecast trajectories and head posescited by 17
- 2019BLVD: Building A Large-scale 5D Semantics Benchmark for Autonomous Drivingcited by 13
- 2017Human Trajectory Prediction using Spatially aware Deep Attention Modelscited by 12
- 2020GraphTCN: Spatio-Temporal Interaction Modeling for Human Trajectory Predictioncited by 12
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Drivingcited by 12
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.