Uncovering Bias in Personal Informatics
Not on the map. Why?
Abstract (arXiv)
Personal informatics (PI) systems, powered by smartphones and wearables, enable people to lead healthier lifestyles by providing meaningful and actionable insights that break down barriers between users and their health information. Today, such systems are used by billions of users for monitoring not only physical activity and sleep but also vital signs and women's and heart health, among others. Despite their widespread usage, the processing of sensitive PI data may suffer from biases, which may entail practical and ethical implications. In this work, we present the first comprehensive empirical and analytical study of bias in PI systems, including biases in raw data and in the entire machine learning life cycle. We use the most detailed framework to date for exploring the different sources of bias and find that biases exist both in the data generation and the model learning and implementation streams. According to our results, the most affected minority groups are users with health issues, such as diabetes, joint issues, and hypertension, and female users, whose data biases are propagated or even amplified by learning models, while intersectional biases can also be observed.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 27 of its 132 references that are in the map. First posted on arXiv 27 Mar 2023.
Builds on
27 of 132 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2017Counterfactual Fairnesscited by 802
- 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2017Multitask learning and benchmarking with clinical time series datacited by 287
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2018Aequitas: A Bias and Fairness Audit Toolkitcited by 145
- 2021DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networkscited by 109
15 more
- 2022A Survey on the Fairness of Recommender Systemscited by 102
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2020Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditingcited by 89
- 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
- 2020Bringing the People Back In: Contesting Benchmark Machine Learning Datasetscited by 43
- 2020Self-supervised transfer learning of physiological representations from free-living wearable datacited by 27
- 2019This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technologycited by 24
- 2018User Fairness in Recommender Systemscited by 20
- 2022Bias in Automated Speaker Recognitioncited by 20
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Datasetcited by 15
- 2017Multi-task Neural Networks for Personalized Pain Recognition from Physiological Signalscited by 11
- 2022Tiny, always-on and fragile: Bias propagation through design choices in on-device machine learning workflowscited by 8
- 2022Error Parity Fairness: Testing for Group Fairness in Regression Taskscited by 5
- 2017Personalized Gaussian Processes for Future Prediction of Alzheimer's Disease Progressioncited by 4
- 2022UBIWEAR: An end-to-end, data-driven framework for intelligent physical activity prediction to empower mHealth interventionscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.