mlsanityData to 14 Oct 2026

AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perception

arXiv 2307.13933 ↗First posted 26 Jul 2023cs.CVcited by 39

Not on the map. Why?

Abstract (arXiv)

Driver distraction has become a significant cause of severe traffic accidents over the past decade. Despite the growing development of vision-driven driver monitoring systems, the lack of comprehensive perception datasets restricts road safety and traffic security. In this paper, we present an AssIstive Driving pErception dataset (AIDE) that considers context information both inside and outside the vehicle in naturalistic scenarios. AIDE facilitates holistic driver monitoring through three distinctive characteristics, including multi-view settings of driver and scene, multi-modal annotations of face, body, posture, and gesture, and four pragmatic task designs for driving understanding. To thoroughly explore AIDE, we provide experimental benchmarks on three kinds of baseline frameworks via extensive methods. Moreover, two fusion strategies are introduced to give new insights into learning effective multi-stream/modal representations. We also systematically investigate the importance and rationality of the key components in AIDE and benchmarks. The project link is https://github.com/ydk122024/AIDE.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 45 of its 106 references that are in the map. First posted on arXiv 26 Jul 2023.

Builds on

45 of 106 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  6. 2014Going Deeper with Convolutionscited by 4,241
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  10. 2018SlowFast Networks for Video Recognitioncited by 1,867
  11. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  12. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
33 more
  1. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
  2. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  4. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  5. 2018End-to-End Multi-Task Learning with Attentioncited by 534
  6. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  7. 2016MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videoscited by 194
  8. 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
  9. 2023Content-based Unrestricted Adversarial Attackcited by 73
  10. 2022Bridging the Domain Gap for Multi-Agent Perceptioncited by 60
  11. 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
  12. 2022Model-Agnostic Multi-Agent Perception Frameworkcited by 51
  13. 2020DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysiscited by 47
  14. 2022Towards Practical Certifiable Patch Defense with Vision Transformercited by 44
  15. 2020Driver Anomaly Detection: A Dataset and Contrastive Learning Approachcited by 41
  16. 2022TSA-Net: Tube Self-Attention Network for Action Quality Assessmentcited by 36
  17. 2023Context De-confounded Emotion Recognitioncited by 34
  18. 2016Brain4Cars: Car That Knows Before You Do via Sensory-Fusion Deep Learning Architecturecited by 31
  19. 2022Boosting the Transferability of Adversarial Attacks with Global Momentum Initializationcited by 29
  20. 2019Driver Distraction Identification with an Ensemble of Convolutional Neural Networkscited by 26
  21. 2023Efficient Decision-based Black-box Patch Attacks on Video Recognitioncited by 21
  22. 2023Query-Efficient Decision-based Black-Box Patch Attackcited by 19
  23. 2022Learning Appearance-motion Normality for Video Anomaly Detectioncited by 17
  24. 2022Efficient universal shuffle attack for visual object trackingcited by 14
  25. 2022A Survey of Video-based Action Quality Assessmentcited by 14
  26. 2022CA-SpaceNet: Counterfactual Analysis for 6D Pose Estimation in Spacecited by 13
  27. 2023Adversarial Contrastive Distillation with Adaptive Denoisingcited by 9
  28. 2020DriverMHG: A Multi-Modal Dataset for Dynamic Recognition of Driver Micro Hand Gestures and a Real-Time Recognition Frameworkcited by 8
  29. 2023Towards Simultaneous Segmentation of Liver Tumors and Intrahepatic Vessels via Cross-attention Mechanismcited by 8
  30. 2023Human 3D Avatar Modeling with Implicit Neural Representation: A Brief Surveycited by 7
  31. 2018Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets with Multi-stream Inputscited by 6
  32. 2023A novel efficient Multi-view traffic-related object detection frameworkcited by 6
  33. 2022Real-Time Driver Monitoring Systems through Modality and View Analysiscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 14; 2025: 13; 2026: 11.

39 papers.

Sort:

By area:

  1. 2024Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalitiescited by 32
  2. 2024Towards Multimodal Sentiment Analysis Debiasing via Bias Purificationcited by 27
  3. 2024Robust Emotion Recognition in Context Debiasingcited by 24
  4. 2024IC3M: In-Car Multimodal Multi-object Monitoring for Abnormal Status of Both Driver and Passengerscited by 20
  5. 2024Can LLMs' Tuning Methods Work in Medical Multimodal Domain?cited by 12
  6. 2024Large Vision-Language Models as Emotion Recognizers in Context Awarenesscited by 12
  7. 2024De-confounded Data-free Knowledge Distillation for Handling Distribution Shiftscited by 11
  8. 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Modelscited by 11
  9. 2024Towards Context-Aware Emotion Recognition Debiasing from a Causal Demystification Perspective via De-confounded Trainingcited by 11
  10. 2024Asynchronous Multimodal Video Sequence Fusion via Learning Modality-Exclusive and -Agnostic Representationscited by 10
  11. 2025MMTL-UniAD: A Unified Framework for Multimodal and Multi-Task Learning in Assistive Driving Perceptioncited by 10
  12. 2024Learning Multi-view Anomaly Detection with Efficient Adaptive Selectioncited by 9
27 more
  1. 2023Sampling to Distill: Knowledge Transfer from Open-World Datacited by 8
  2. 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Visioncited by 8
  3. 2026Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rolloutcited by 6
  4. 2024PG-Attack: A Precision-Guided Adversarial Attack Framework Against Vision Foundation Models for Autonomous Drivingcited by 5
  5. 2025Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysiscited by 4
  6. 2024Self-Cooperation Knowledge Distillation for Novel Class Discoverycited by 3
  7. 2025TEM^3-Learning: Time-Efficient Multimodal Multi-Task Learning for Advanced Assistive Drivingcited by 3
  8. 2025DSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Riskscited by 3
  9. 2025Sage Deer: A Super-Aligned Driving Generalist Is Your Copilotcited by 2
  10. 2025PDB-Eval: An Evaluation of Large Multimodal Models for Description and Explanation of Personalized Driving Behaviorcited by 2
  11. 2026UV-M3TL: A Unified and Versatile Multimodal Multi-Task Learning Framework for Assistive Driving Perceptioncited by 2
  12. 2026BATON: A Multimodal Benchmark for Bidirectional Automation Transition Observation in Naturalistic Drivingcited by 2
  13. 2026MILD: Mediator Agent System with Bidirectional Perception and Multi-Layered Alignment for Human-Vehicle Collaborationcited by 2
  14. 2025Boosting Adversarial Transferability with Spatial Adversarial Alignmentcited by 1
  15. 2025Learning Multi-view Multi-class Anomaly Detectioncited by 1
  16. 2025Last Layer Hamiltonian Monte Carlocited by 1
  17. 2026Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Predictioncited by 1
  18. 2026DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecastingcited by 1
  19. 2024Improving Adversarial Transferability with Neighbourhood Gradient Informationcited by 0
  20. 2025A Simulator Dataset to Support the Study of Impaired Drivingcited by 0
  21. 2025Latent Uncertainty Representations for Video-based Driver Action and Intention Recognitioncited by 0
  22. 2025Towards Safer and Understandable Driver Intention Predictioncited by 0
  23. 2026Cognitive-Causal Multi-Task Learning with Psychological State Conditioning for Assistive Driving Perceptioncited by 0
  24. 2026MOTOR: A Multimodal Dataset for Two-Wheeler Rider Behavior Understandingcited by 0
  25. 2026Safety-Aware Evaluation of LLM-Generated Driver Intervention Messages through Multi-Task Risk Fusioncited by 0
  26. 2026Vision-Guided Text Prompt Tuning for Multimodal Sentiment Analysiscited by 0
  27. 2026TriDrive: Joint Driver, Vehicle, and Road Modeling for Forecasting and Driver Monitoringcited by 0