# Smartphone Sensors for Modeling Human-Computer Interaction: General Outlook and Research Datasets for User Authentication

arXiv: https://arxiv.org/abs/2006.00790 · HTML: https://mlsanity.com/paper/2006.00790/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Jun 2020.

## Built on by (most cited first, 17 of 17)

- [Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment](https://mlsanity.com/paper/2302.10908/) (2023)
- [TypeNet: Deep Learning Keystroke Biometrics](https://mlsanity.com/paper/2101.05570/) (2021)
- [M2LADS: A System for Generating MultiModal Learning Analytics Dashboards in Open Education](https://mlsanity.com/paper/2305.12561/) (2023)
- [ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learning](https://mlsanity.com/paper/2112.09165/) (2021)
- [BehavePassDB: Public Database for Mobile Behavioral Biometrics and Benchmark Evaluation](https://mlsanity.com/paper/2206.02502/) (2022)
- [SMARTe-VR: Student Monitoring and Adaptive Response Technology for e-Learning in Virtual Reality](https://mlsanity.com/paper/2501.10977/) (2025)
- [IJCB 2022 Mobile Behavioral Biometrics Competition (MobileB2C)](https://mlsanity.com/paper/2210.03072/) (2022)
- [Mobile Behavioral Biometrics for Passive Authentication](https://mlsanity.com/paper/2203.07300/) (2022)
- [Leveraging Automatic Personalised Nutrition: Food Image Recognition Benchmark and Dataset based on Nutrition Taxonomy](https://mlsanity.com/paper/2211.07440/) (2022)
- [AI4Food-NutritionFW: A Novel Framework for the Automatic Synthesis and Analysis of Eating Behaviours](https://mlsanity.com/paper/2309.06308/) (2023)
- [VideoRun2D: Cost-Effective Markerless Motion Capture for Sprint Biomechanics](https://mlsanity.com/paper/2409.10175/) (2024)
- [Comparison of Visual Trackers for Biomechanical Analysis of Running](https://mlsanity.com/paper/2505.04713/) (2025)
- [Blockchain and Biometrics: Survey, GDPR Analysis, and Future Directions](https://mlsanity.com/paper/2302.10883/) (2023)
- [Your device may know you better than you know yourself -- continuous authentication on novel dataset using machine learning](https://mlsanity.com/paper/2403.03832/) (2024)
- [mPSAuth: Privacy-Preserving and Scalable Authentication for Mobile Web Applications](https://mlsanity.com/paper/2210.04777/) (2022)
- [Mobile Interaction for Assessing Fatigue, Sleep, and Activity in Neurodegenerative and Chronic Diseases](https://mlsanity.com/paper/2608.06380/) (2026)
- [VideoRun2D Demo: Markerless Body Tracking for Biomechanical Analysis of Running](https://mlsanity.com/paper/2608.19480/) (2026)

## Abstract (arXiv)

In this paper we list the sensors commonly available in modern smartphones and provide a general outlook of the different ways these sensors can be used for modeling the interaction between human and smartphones. We then provide a taxonomy of applications that can exploit the signals originated by these sensors in three different dimensions, depending on the main information content embedded in the signals exploited in the application: neuromotor skills, cognitive functions, and behaviors/routines. We then summarize a representative selection of existing research datasets in this area, with special focus on applications related to user authentication, including key features and a selection of the main research results obtained on them so far. Then, we perform the experimental work using the HuMIdb database (Human Mobile Interaction database), a novel multimodal mobile database that includes 14 mobile sensors captured from 600 participants. We evaluate a biometric authentication system based on simple linear touch gestures using a Siamese Neural Network architecture. Very promising results are achieved with accuracies up to 87% for person authentication based on a simple and fast touch gesture.