Biometrics and Behavior Analysis for Detecting Distractions in e-Learning
Not on the map. Why?
Abstract (arXiv)
In this article, we explore computer vision approaches to detect abnormal head pose during e-learning sessions and we introduce a study on the effects of mobile phone usage during these sessions. We utilize behavioral data collected from 120 learners monitored while participating in a MOOC learning sessions. Our study focuses on the influence of phone-usage events on behavior and physiological responses, specifically attention, heart rate, and meditation, before, during, and after phone usage. Additionally, we propose an approach for estimating head pose events using images taken by the webcam during the MOOC learning sessions to detect phone-usage events. Our hypothesis suggests that head posture undergoes significant changes when learners interact with a mobile phone, contrasting with the typical behavior seen when learners face a computer during e-learning sessions. We propose an approach designed to detect deviations in head posture from the average observed during a learner's session, operating as a semi-supervised method. This system flags events indicating alterations in head posture for subsequent human review and selection of mobile phone usage occurrences with a sensitivity over 90%.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 17 of its 54 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
17 of 54 references.
References · 17
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2020BlazePose: On-device Real-time Body Pose trackingcited by 112
- 2020Detecting Attended Visual Targets in Videocited by 76
- 2019BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUscited by 74
- 2020WHENet: Real-time Fine-Grained Estimation for Wide Range Head Posecited by 47
- 2020mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimationcited by 19
- 2022edBB-Demo: Biometrics and Behavior Analysis for Online Educational Platformscited by 18
- 2019edBB: Biometrics and Behavior for Assessing Remote Educationcited by 17
5 more
- 2023M2LADS: A System for Generating MultiModal Learning Analytics Dashboards in Open Educationcited by 15
- 2021ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learningcited by 13
- 2020Heart Rate Estimation from Face Videos for Student Assessment: Experiments on edBBcited by 12
- 2020RealHePoNet: a robust single-stage ConvNet for head pose estimation in the wildcited by 7
- 2023MATT: Multimodal Attention Level Estimation for e-learning Platformscited by 7
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 3.
10 papers.
- 2024A multimodal dataset for understanding the impact of mobile phones on remote online virtual educationcited by 11
- 2024DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learningcited by 7
- 2025SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Realitycited by 6
- 2025AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learningcited by 6
- 2026EduEVAL-DB: A Role-Based Dataset for Pedagogical Risk Evaluation in Educational Explanationscited by 4
- 2025M2LADS Demo: A System for Generating Multimodal Learning Analytics Dashboardscited by 3
- 2025Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videoscited by 3
- 2025Enhancing Online Learning by Integrating Biosensors and Multimodal Learning Analytics for Detecting and Predicting Student Behavior: A Reviewcited by 3
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyondcited by 3
- 2026AIriskEval-edu: New Dataset for Risk Assessment in AI-mediated K-12 Educational Explanationscited by 2
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyond2 Jul 2026
- 2026AIriskEval-edu: New Dataset for Risk Assessment in AI-mediated K-12 Educational Explanations2 Jul 2026
- 2026EduEVAL-DB: A Role-Based Dataset for Pedagogical Risk Evaluation in Educational Explanations17 Feb 2026
- 2025Enhancing Online Learning by Integrating Biosensors and Multimodal Learning Analytics for Detecting and Predicting Student Behavior: A Review9 Sep 2025
- 2025Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos1 Aug 2025
- 2025AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning20 Jun 2025
- 2025M2LADS Demo: A System for Generating Multimodal Learning Analytics Dashboards21 Feb 2025
- 2025SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality19 Jan 2025
- 2024A multimodal dataset for understanding the impact of mobile phones on remote online virtual education13 Dec 2024
- 2024DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learning10 Aug 2024