# A multimodal dataset for understanding the impact of mobile phones on remote online virtual education

arXiv: https://arxiv.org/abs/2412.14195 · HTML: https://mlsanity.com/paper/2412.14195/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 71 references that are in the map.
- First posted on arXiv 13 Dec 2024.

## Builds on (most cited first, 22 of 22)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks](https://mlsanity.com/paper/1905.11946/) (2019)
- [MobileNetV2: Inverted Residuals and Linear Bottlenecks](https://mlsanity.com/paper/1801.04381/) (2018)
- [CenterNet: Keypoint Triplets for Object Detection](https://mlsanity.com/paper/1904.08189/) (2019)
- [MediaPipe: A Framework for Building Perception Pipelines](https://mlsanity.com/paper/1906.08172/) (2019)
- [RetinaFace: Single-stage Dense Face Localisation in the Wild](https://mlsanity.com/paper/1905.00641/) (2019)
- [BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUs](https://mlsanity.com/paper/1907.05047/) (2019)
- [WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose](https://mlsanity.com/paper/2005.10353/) (2020)
- [mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimation](https://mlsanity.com/paper/2006.05327/) (2020)
- [edBB-Demo: Biometrics and Behavior Analysis for Online Educational Platforms](https://mlsanity.com/paper/2211.09210/) (2022)
- [edBB: Biometrics and Behavior for Assessing Remote Education](https://mlsanity.com/paper/1912.04786/) (2019)
- [M2LADS: A System for Generating MultiModal Learning Analytics Dashboards in Open Education](https://mlsanity.com/paper/2305.12561/) (2023)
- [A multimodal sensor dataset for continuous stress detection of nurses in a hospital](https://mlsanity.com/paper/2108.07689/) (2021)
- [ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learning](https://mlsanity.com/paper/2112.09165/) (2021)
- [BeCAPTCHA-Mouse: Synthetic Mouse Trajectories and Improved Bot Detection](https://mlsanity.com/paper/2005.00890/) (2020)
- [Heart Rate Estimation from Face Videos for Student Assessment: Experiments on edBB](https://mlsanity.com/paper/2006.00825/) (2020)
- [VAAD: Visual Attention Analysis Dashboard applied to e-Learning](https://mlsanity.com/paper/2405.20091/) (2024)
- [Biometrics and Behavior Analysis for Detecting Distractions in e-Learning](https://mlsanity.com/paper/2405.15434/) (2024)
- [mEBAL2 Database and Benchmark: Image-based Multispectral Eyeblink Detection](https://mlsanity.com/paper/2309.07880/) (2023)
- [RealHePoNet: a robust single-stage ConvNet for head pose estimation in the wild](https://mlsanity.com/paper/2011.01890/) (2020)
- [DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learning](https://mlsanity.com/paper/2408.05523/) (2024)
- [Enhancing Trust in eAssessment - the TeSLA System Solution](https://mlsanity.com/paper/1905.04985/) (2019)

## Built on by (most cited first, 12 of 12)

- [Is My Text in Your AI Model? Gradient-based Membership Inference Test applied to LLMs](https://mlsanity.com/paper/2503.07384/) (2025)
- [SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality](https://mlsanity.com/paper/2501.10977/) (2025)
- [AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning](https://mlsanity.com/paper/2506.17364/) (2025)
- [MOSAIC-F: A Framework for Enhancing Students' Oral Presentation Skills through Personalized Feedback](https://mlsanity.com/paper/2506.08634/) (2025)
- [EduEVAL-DB: A Role-Based Dataset for Pedagogical Risk Evaluation in Educational Explanations](https://mlsanity.com/paper/2602.15531/) (2026)
- [M2LADS Demo: A System for Generating Multimodal Learning Analytics Dashboards](https://mlsanity.com/paper/2502.15363/) (2025)
- [Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos](https://mlsanity.com/paper/2508.00748/) (2025)
- [Enhancing Online Learning by Integrating Biosensors and Multimodal Learning Analytics for Detecting and Predicting Student Behavior: A Review](https://mlsanity.com/paper/2509.07742/) (2025)
- [A Multimodal Dataset of Student Oral Presentations with Sensors and Evaluation Data](https://mlsanity.com/paper/2601.07576/) (2026)
- [AIriskEval-edu Demo: Auditing of Pedagogical Risks in Educational Explanations](https://mlsanity.com/paper/2607.25634/) (2026)
- [VideoRun2D Demo: Markerless Body Tracking for Biomechanical Analysis of Running](https://mlsanity.com/paper/2608.19480/) (2026)
- [inLoRA-MINT: Internal Representations for Auditing Training Data in Domain-adapted LLMs](https://mlsanity.com/paper/2610.18051/) (2026)

## Abstract (arXiv)

This work presents the IMPROVE dataset, a multimodal resource designed to evaluate the effects of mobile phone usage on learners during online education. It includes behavioral, biometric, physiological, and academic performance data collected from 120 learners divided into three groups with different levels of phone interaction, enabling the analysis of the impact of mobile phone usage and related phenomena such as nomophobia. A setup involving 16 synchronized sensors-including EEG, eye tracking, video cameras, smartwatches, and keystroke dynamics-was used to monitor learner activity during 30-minute sessions involving educational videos, document reading, and multiple-choice tests. Mobile phone usage events, including both controlled interventions and uncontrolled interactions, were labeled by supervisors and refined through a semi-supervised re-labeling process. Technical validation confirmed signal quality, and statistical analyses revealed biometric changes associated with phone usage. The dataset is publicly available for research through GitHub and Science Data Bank, with synchronized recordings from three platforms (edBB, edX, and LOGGE), provided in standard formats (.csv, .mp4, .wav, and .tsv), and accompanied by a detailed guide.