Cognitive-Causal Multi-Task Learning with Psychological State Conditioning for Assistive Driving Perception
Not on the map. Why?
Abstract (arXiv)
Multi-task learning for advanced driver assistance systems requires modeling the complex interplay between driver internal states and external traffic environments. However, existing methods treat recognition tasks as flat and independent objectives, failing to exploit the cognitive causal structure underlying driving behavior. In this paper, we propose CauPsi, a cognitive science-grounded causal multi-task learning framework that explicitly models the hierarchical dependencies among Traffic Context Recognition (TCR), Vehicle Context Recognition (VCR), Driver Emotion Recognition (DER), and Driver Behavior Recognition (DBR). The proposed framework introduces two key mechanisms. First, a Causal Task Chain propagates upstream task predictions to downstream tasks via learnable prototype embeddings, realizing the cognitive cascade from environmental perception to behavioral regulation in a differentiable manner. Second, Cross-Task Psychological Conditioning (CTPC) estimates a psychological state signal from driver facial expressions and body posture and injects it as a conditioning input to all tasks including environmental recognition, thereby modeling the modulatory effect of driver internal states on cognitive and decision-making processes. Evaluated on the AIDE dataset, CauPsi achieves a mean accuracy of 82.71% with only 5.05M parameters, surpassing prior work by +1.0% overall, with notable improvements on DER (+3.65%) and DBR (+7.53%). Ablation studies validate the independent contribution of each component, and analysis of the psychological state signal confirms that it acquires systematic task-label-dependent patterns in a self-supervised manner without explicit psychological annotations.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 42 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
18 of 42 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,786
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,264
- 2019Searching for MobileNetV3cited by 1,990
- 2018SlowFast Networks for Video Recognitioncited by 1,864
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,614
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,199
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,134
- 2021Video Swin Transformercited by 1,090
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
6 more
- 2021YOLOP: You Only Look Once for Panoptic Driving Perceptioncited by 82
- 2021Multi-task Learning with Attention for End-to-end Autonomous Drivingcited by 49
- 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
- 2023Relational Multi-Task Learning: Modeling Relations between Data and Taskscited by 15
- 2024Multi-task Learning for Real-time Autonomous Driving Leveraging Task-adaptive Attention Generatorcited by 6
- 2024MIPD: A Multi-sensory Interactive Perception Dataset for Embodied Intelligent Drivingcited by 5
Built on by
Not cited yet.