PQ-DAF: Pose-driven Quality-controlled Data Augmentation for Data-scarce Driver Distraction Detection
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
Abstract (arXiv)
Driver distraction detection is essential for improving traffic safety and reducing road accidents. However, existing models often suffer from degraded generalization when deployed in real-world scenarios. This limitation primarily arises from the few-shot learning challenge caused by the high cost of data annotation in practical environments, as well as the substantial domain shift between training datasets and target deployment conditions. To address these issues, we propose a Pose-driven Quality-controlled Data Augmentation Framework (PQ-DAF) that leverages a vision-language model for sample filtering to cost-effectively expand training data and enhance cross-domain robustness. Specifically, we employ a Progressive Conditional Diffusion Model (PCDMs) to accurately capture key driver pose features and synthesize diverse training examples. A sample quality assessment module, built upon the CogVLM vision-language model, is then introduced to filter out low-quality synthetic samples based on a confidence threshold, ensuring the reliability of the augmented dataset. Extensive experiments demonstrate that PQ-DAF substantially improves performance in few-shot driver distraction detection, achieving significant gains in model generalization under data-scarce conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 49 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
29 of 49 references.
Closest ancestors · 1
Same direction, newest first
Other references · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2022A ConvNet for the 2020scited by 3,579
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2019Searching for MobileNetV3cited by 1,994
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
16 more
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 261
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
- 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
- 2023GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Mapscited by 23
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Zero-Shot Distracted Driver Detection via Vision Language Models with Double Decoupling
- 2024DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification
- 2026DiffAttn: Diffusion-Based Drivers' Visual Attention Prediction with LLM-Enhanced Semantic Reasoning
- 2024Cross-Camera Distracted Driver Classification through Feature Disentanglement and Contrastive Learning
- 2024Multi-Frame Vision-Language Model for Long-form Reasoning in Driver Behavior Analysis
- 2025CrashChat: A Multimodal Large Language Model for Multitask Traffic Crash Video Analysis
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
- 2025Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos