mlsanityData to 14 Oct 2026

PQ-DAF: Pose-driven Quality-controlled Data Augmentation for Data-scarce Driver Distraction Detection

arXiv 2508.10397 ↗First posted 14 Aug 2025cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

Abstract (arXiv)

Driver distraction detection is essential for improving traffic safety and reducing road accidents. However, existing models often suffer from degraded generalization when deployed in real-world scenarios. This limitation primarily arises from the few-shot learning challenge caused by the high cost of data annotation in practical environments, as well as the substantial domain shift between training datasets and target deployment conditions. To address these issues, we propose a Pose-driven Quality-controlled Data Augmentation Framework (PQ-DAF) that leverages a vision-language model for sample filtering to cost-effectively expand training data and enhance cross-domain robustness. Specifically, we employ a Progressive Conditional Diffusion Model (PCDMs) to accurately capture key driver pose features and synthesize diverse training examples. A sample quality assessment module, built upon the CogVLM vision-language model, is then introduced to filter out low-quality synthetic samples based on a confidence threshold, ensuring the reliability of the augmented dataset. Extensive experiments demonstrate that PQ-DAF substantially improves performance in few-shot driver distraction detection, achieving significant gains in model generalization under data-scarce conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 49 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

29 of 49 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videos16 Jun

Other references · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  5. 2022A ConvNet for the 2020scited by 3,579
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  7. 2014Conditional Generative Adversarial Netscited by 2,162
  8. 2019Searching for MobileNetV3cited by 1,994
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  10. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
16 more
  1. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  2. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
  3. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  4. 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 261
  5. 2017Deformable GANs for Pose-based Human Image Generationcited by 166
  6. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
  7. 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
  8. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
  9. 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
  10. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
  11. 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
  12. 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
  13. 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
  14. 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
  15. 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
  16. 2023GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Mapscited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Zero-Shot Distracted Driver Detection via Vision Language Models with Double Decoupling
  2. 2024DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification
  3. 2026DiffAttn: Diffusion-Based Drivers' Visual Attention Prediction with LLM-Enhanced Semantic Reasoning
  4. 2024Cross-Camera Distracted Driver Classification through Feature Disentanglement and Contrastive Learning
  5. 2024Multi-Frame Vision-Language Model for Long-form Reasoning in Driver Behavior Analysis
  6. 2025CrashChat: A Multimodal Large Language Model for Multitask Traffic Crash Video Analysis
  7. 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
  8. 2025Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos