# Vision Transformers and YoloV5 based Driver Drowsiness Detection Framework

arXiv: https://arxiv.org/abs/2209.01401 · HTML: https://mlsanity.com/paper/2209.01401/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 28 references that are in the map.
- First posted on arXiv 3 Sep 2022.

## Builds on (most cited first, 4 of 4)

- [YOLO5Face: Why Reinventing a Face Detector](https://mlsanity.com/paper/2105.12931/) (2021)
- [A Realistic Dataset and Baseline Temporal Model for Early Drowsiness Detection](https://mlsanity.com/paper/1904.07312/) (2019)
- [Bias Remediation in Driver Drowsiness Detection systems using Generative Adversarial Networks](https://mlsanity.com/paper/1912.12123/) (2019)
- [Drivers Drowsiness Detection using Condition-Adaptive Representation Learning Framework](https://mlsanity.com/paper/1910.09722/) (2019)

## Built on by (most cited first, 4 of 4)

- [Video Vision Transformers for Violence Detection](https://mlsanity.com/paper/2209.03561/) (2022)
- [A Survey on Drowsiness Detection -- Modern Applications and Methods](https://mlsanity.com/paper/2408.12990/) (2024)
- [Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition](https://mlsanity.com/paper/2305.00552/) (2023)
- [Privacy-Preserving Driver Drowsiness Detection with Spatial Self-Attention and Federated Learning](https://mlsanity.com/paper/2508.00287/) (2025)

## Abstract (arXiv)

Human drivers have distinct driving techniques, knowledge, and sentiments due to unique driving traits. Driver drowsiness has been a serious issue endangering road safety; therefore, it is essential to design an effective drowsiness detection algorithm to bypass road accidents. Miscellaneous research efforts have been approached the problem of detecting anomalous human driver behaviour to examine the frontal face of the driver and automobile dynamics via computer vision techniques. Still, the conventional methods cannot capture complicated driver behaviour features. However, with the origin of deep learning architectures, a substantial amount of research has also been executed to analyze and recognize driver's drowsiness using neural network algorithms. This paper introduces a novel framework based on vision transformers and YoloV5 architectures for driver drowsiness recognition. A custom YoloV5 pre-trained architecture is proposed for face extraction with the aim of extracting Region of Interest (ROI). Owing to the limitations of previous architectures, this paper introduces vision transformers for binary image classification which is trained and validated on a public dataset UTA-RLDD. The model had achieved 96.2% and 97.4% as it's training and validation accuracies respectively. For the further evaluation, proposed framework is tested on a custom dataset of 39 participants in various light circumstances and achieved 95.5% accuracy. The conducted experimentations revealed the significant potential of our framework for practical applications in smart transportation systems.