mlsanityData to 14 Oct 2026

DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting

arXiv 2609.08117 ↗First posted 8 Sep 2026cs.CV cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Driver motion can provide cues to ongoing behavior, attention, and near-term driving intent. However, most existing driver-centric datasets focus on recognizing predefined driver behaviors from short video clips, while human motion forecasting benchmarks largely target motion outside the vehicle. We introduce DriveMotion, a multi-source benchmark for continuous driver motion forecasting. DriveMotion contains 393 hours of 133-keypoint motion sequences at 10 Hz from 360 drivers, integrating naturalistic driving data, curated public in-cabin videos, and the AIDE dataset into a unified representation with per-joint validity masks and synchronized driving context. Naturalistic driving contains long periods of limited body movement, making uniformly sampled evaluation dominated by persistence and less sensitive to brief but behaviorally meaningful motion. To address this, we use dynamics-anchored evaluation, placing forecasting windows around vehicle maneuvers identified offline from CAN signals without providing CAN to the model at inference. Arm motion in pre-maneuver windows is 3.4x greater than in route-matched stable-driving controls. On these anchored windows, learned models reduce forecasting error over persistence by up to 15%, while maneuver-enriched training improves forecast-derived Part-State F1 by 44% over the zero-motion reference. Training on the full multi-source corpus further reduces forecasting error on held-out web drivers by 38% compared with BATON-only training. DriveMotion provides identity-disjoint splits, fixed evaluation subsets, and reference implementations for reproducible evaluation of continuous driver motion forecasting. The dataset and benchmark are available at https://huggingface.co/datasets/HenryYHW/DriveMotion

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

45 of 58 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  7. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  8. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  9. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  10. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  11. 2017On human motion prediction using recurrent neural networkscited by 338
  12. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
33 more
  1. 2018Machine Theory of Mindcited by 226
  2. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  3. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  4. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
  5. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
  6. 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 156
  7. 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
  8. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
  9. 2024MotionLLM: Understanding Human Behaviors from Human Motions and Videoscited by 90
  10. 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
  11. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  12. 2024MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understandingcited by 59
  13. 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
  14. 2020DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysiscited by 47
  15. 2020Driver Anomaly Detection: A Dataset and Contrastive Learning Approachcited by 41
  16. 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
  17. 2018A Commute in Data: The comma2k19 Datasetcited by 33
  18. 2016Brain4Cars: Car That Knows Before You Do via Sensory-Fusion Deep Learning Architecturecited by 31
  19. 2024Human Motion Instruction Tuningcited by 29
  20. 2022TransDARC: Transformer-based Driver Activity Recognition with Latent Space Feature Calibrationcited by 25
  21. 2024RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimationcited by 19
  22. 2023CEMFormer: Learning to Predict Driver Intentions from In-Cabin and External Cameras via Spatial-Temporal Transformerscited by 9
  23. 2020The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attentioncited by 8
  24. 2026Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rolloutcited by 6
  25. 2025MoFM: A Large-Scale Human Motion Foundation Modelcited by 5
  26. 2025Waymo-3DSkelMo: A Multi-Agent 3D Skeletal Motion Dataset for Pedestrian Interaction Modeling in Autonomous Drivingcited by 5
  27. 2026Modeling 3D Pedestrian-Vehicle Interactions for Vehicle-Conditioned Pose Forecastingcited by 3
  28. 2026Risk-Aware Selective Multimodal Driver Monitoring with Driver-State World Modelingcited by 3
  29. 2024PO-GUISE+: Pose and object guided transformer token selection for efficient driver action recognitioncited by 2
  30. 2026BATON: A Multimodal Benchmark for Bidirectional Automation Transition Observation in Naturalistic Drivingcited by 2
  31. 2024Automated Vehicle Driver Monitoring Dataset from Real-World Scenarioscited by 1
  32. 2026DAOS: A Multimodal In-cabin Behavior Monitoring with Driver Action-Object Synergy Datasetcited by 1
  33. 2026Mental World Modelingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.