Identifying Ethical Biases in Action Recognition Models
Not on the map. Why?
Abstract (arXiv)
Human Action Recognition (HAR) models are increasingly deployed in high-stakes environments, yet their fairness across different human appearances has not been analyzed. We introduce a framework for auditing bias in HAR models using synthetic video data, generated with full control over visual identity attributes such as skin color. Unlike prior work that focuses on static images or pose estimation, our approach preserves temporal consistency, allowing us to isolate and test how changes to a single attribute affect model predictions. Through controlled interventions using the BEDLAM simulation platform, we show whether some popular HAR models exhibit statistically significant biases on the skin color even when the motion remains identical. Our results highlight how models may encode unwanted visual associations, and we provide evidence of systematic errors across groups. This work contributes a framework for auditing HAR models and supports the development of more transparent, accountable systems in light of upcoming regulatory standards.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 60 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
35 of 60 references.
References · 35
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2021Multiscale Vision Transformerscited by 897
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
- 2020Rescaling Egocentric Visioncited by 540
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
23 more
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 265
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2018Human Action Recognition and Prediction: A Surveycited by 227
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2020Human Action Recognition from Various Data Modalities: A Reviewcited by 163
- 2019Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognitioncited by 117
- 2019Synthetic Humans for Action Recognition from Unseen Viewpointscited by 46
- 2022Large-scale Robustness Analysis of Video Action Recognition Modelscited by 29
- 2022A Survey on Video Action Recognition in Sports: Datasets, Methods and Applicationscited by 28
- 2019SynthCity: A large scale synthetic point cloudcited by 26
- 2020ETRI-Activity3D: A Large-Scale RGB-D Dataset for Robots to Recognize Daily Activities of the Elderlycited by 26
- 2023Benchmarking Algorithmic Bias in Face Recognition: An Experimental Approach Using Synthetic Faces and Human Evaluationcited by 25
- 2016Human Action Recognition without Humancited by 17
- 2022Is Appearance Free Action Recognition Possible?cited by 16
- 2025VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Modelscited by 14
- 2025A Large Scale Analysis of Gender Biases in Text-to-Image Generative Modelscited by 14
- 2020IntegralAction: Pose-driven Feature Integration for Robust Human Action Recognition in Videoscited by 12
- 2024Leveraging Temporal Contextualization for Video Action Recognitioncited by 9
- 2020Taking A Closer Look at Synthesis: Fine-grained Attribute Analysis for Person Re-Identificationcited by 6
- 2025Metamorphic Testing for Pose Estimation Systemscited by 3
- 2016Revisiting Human Action Recognition: Personalization vs. Generalizationcited by 2
- 2020Personalization in Human Activity Recognitioncited by 2
- 2020View-invariant action recognitioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.