Predictive Inequity in Object Detection
Not on the map. Why?
Abstract (arXiv)
In this work, we investigate whether state-of-the-art object detection systems have equitable predictive performance on pedestrians with different skin tones. This work is motivated by many recent examples of ML and vision systems displaying higher error rates for certain demographic groups than others. We annotate an existing large scale dataset which contains pedestrians, BDD100K, with Fitzpatrick skin tones in ranges [1-3] or [4-6]. We then provide an in-depth comparative analysis of performance between these two skin tone groupings, finding that neither time of day nor occlusion explain this behavior, suggesting this disparity is not merely the result of pedestrians in the 4-6 range appearing in more difficult scenes for detection. We investigate to what extent time of day, occlusion, and reweighting the supervised loss during training affect this predictive bias.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 20; 2023: 25; 2024: 11; 2025: 6; 2026: 1.
77 papers.
Sort:
By area:
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2023FACET: Fairness in Computer Vision Evaluation Benchmarkcited by 58
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Biascited by 51
- 2021A Step Toward More Inclusive People Annotations for Fairnesscited by 46
- 2022American == White in Multimodal Language-and-Image AIcited by 39
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
- 2022Quantifying Societal Bias Amplification in Image Captioningcited by 37
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2022Evidence for Hypodescent in Visual Semantic AIcited by 30
38 more
- 2022Markedness in Visual Semantic AIcited by 29
- 2023Survey of Social Bias in Vision-Language Modelscited by 26
- 2023FACTS: First Amplify Correlations and Then Slice to Discover Biascited by 26
- 2021Measuring Model Biases in the Absence of Ground Truthcited by 24
- 2021UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Modelscited by 23
- 2022Men Also Do Laundry: Multi-Attribute Bias Amplificationcited by 21
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actionscited by 21
- 2021Latent Space Smoothing for Individually Fair Representationscited by 18
- 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
- 2023Ethical Considerations for Responsible Data Curationcited by 17
- 2023Model-Agnostic Gender Debiased Image Captioningcited by 17
- 2023Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Colorcited by 17
- 2021Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIcited by 16
- 2021Reliability and Validity of Image-Based and Self-Reported Skin Phenotype Metricscited by 15
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataCompcited by 15
- 2022Robots Enact Malignant Stereotypescited by 14
- 2022MMD-B-Fair: Learning Fair Representations with Statistical Testingcited by 13
- 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 12
- 2021From Learning to Relearning: A Framework for Diminishing Bias in Social Robot Navigationcited by 11
- 2021Does Data Repair Lead to Fair Models? Curating Contextually Fair Data To Reduce Model Biascited by 11
- 2022Speciesist bias in AI -- How AI applications perpetuate discrimination and unfair outcomes against animalscited by 11
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shiftscited by 11
- 2022Simplicity Bias Leads to Amplified Performance Disparitiescited by 11
- 2023Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasetscited by 11
- 2024A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Modelscited by 11
- 2022Fairness and Bias in Robot Learningcited by 10
- 2023Bias Behind the Wheel: Fairness Testing of Autonomous Driving Systemscited by 7
- 2023Fairness-aware Vision Transformer via Debiased Self-Attentioncited by 6
- 2021DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalizationcited by 5
- 2022Casual Conversations v2: Designing a large consent-driven dataset to measure algorithmic bias and robustnesscited by 5
- 2023(Ir)rationality in AI: State of the Art, Research Challenges and Open Questionscited by 5
- 2025ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognitioncited by 5
- 2025VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysiscited by 5
- 2021Adaptive Autonomy in Human-on-the-Loop Vision-Based Robotics Systemscited by 4
- 2023Mitigating Bias in Visual Transformers via Targeted Alignmentcited by 4
- 2023Fairness in Ranking under Disparate Uncertaintycited by 4
- 2024PathwayBench: Assessing Routability of Pedestrian Pathway Networks Inferred from Multi-City Imagerycited by 4
- 2021Human Imperceptible Attacks and Applications to Improve Fairnesscited by 3
50 most cited of 77 All 77 (JSON)
- 2026WIDER-FAIR: An Annotated Version of the WIDER-FACE Dataset for Fairness Evaluation30 Jun 2026
- 2025Privacy Beyond Pixels: Latent Anonymization for Privacy-Preserving Video Understanding11 Nov 2025
- 2025Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent24 Oct 2025
- 2025Emergent AI Surveillance: Overlearned Person Re-Identification and Its Mitigation in Law Enforcement Context7 Oct 2025
- 2025Beyond Overall Accuracy: Pose- and Occlusion-driven Fairness Analysis in Pedestrian Detection for Autonomous Driving30 Sep 2025
- 2025VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysis6 May 2025
- 2025ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition31 Jan 2025
- 2024Pre-training for Action Recognition with Automatically Generated Fractal Datasets26 Nov 2024
- 2024Optimizing importance weighting in the presence of sub-population shifts18 Oct 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024PathwayBench: Assessing Routability of Pedestrian Pathway Networks Inferred from Multi-City Imagery23 Jul 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
38 more
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection under Challenging Weather31 May 2024
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp13 May 2024
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness21 Feb 2024
- 2024A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models21 Feb 2024
- 2024Analyzing and Mitigating Bias for Vulnerable Classes: Towards Balanced Representation in Dataset18 Jan 2024
- 2023GroupMixNorm Layer for Learning Fair Models19 Dec 2023
- 2023Attribute Annotation and Bias Evaluation in Visual Datasets for Autonomous Driving11 Dec 2023
- 2023SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata28 Nov 2023
- 2023(Ir)rationality in AI: State of the Art, Research Challenges and Open Questions28 Nov 2023
- 2023AI Hazard Management: A framework for the systematic management of root causes for AI risks25 Oct 2023
- 2023FACTS: First Amplify Correlations and Then Slice to Discover Bias29 Sep 2023
- 2023Survey of Social Bias in Vision-Language Models24 Sep 2023
- 2023Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color10 Sep 2023
- 2023Fairness in Ranking under Disparate Uncertainty4 Sep 2023
- 2023FACET: Fairness in Computer Vision Evaluation Benchmark31 Aug 2023
- 2023TorchQL: A Programming Framework for Integrity Constraints in Machine Learning13 Aug 2023
- 2023Bias Behind the Wheel: Fairness Testing of Autonomous Driving Systems5 Aug 2023
- 2023Unbiased Image Synthesis via Manifold Guidance in Diffusion Models17 Jul 2023
- 2023ICON2: Reliably Benchmarking Predictive Inequity in Object Detection7 Jun 2023
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation1 Jun 2023
- 2023Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets15 May 2023
- 2023Model-Agnostic Gender Debiased Image Captioning7 Apr 2023
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Bias6 Apr 2023
- 2023Variation of Gender Biases in Visual Recognition Models Before and After Finetuning14 Mar 2023
- 2023APE: An Open and Shared Annotated Dataset for Learning Urban Pedestrian Path Networks4 Mar 2023
- 2023On Comparing Fair Classifiers under Data Bias12 Feb 2023
- 2023Mitigating Bias in Visual Transformers via Targeted Alignment8 Feb 2023
- 2023Ethical Considerations for Responsible Data Curation7 Feb 2023
- 2023Fairness-aware Vision Transformer via Debiased Self-Attention31 Jan 2023
- 2023Uncertainty Quantification for Local Model Explanations Without Model Access13 Jan 2023
- 2022Simplicity Bias Leads to Amplified Performance Disparities13 Dec 2022
- 2022MMD-B-Fair: Learning Fair Representations with Statistical Testing15 Nov 2022
- 2022Casual Conversations v2: Designing a large consent-driven dataset to measure algorithmic bias and robustness10 Nov 2022
- 2022Men Also Do Laundry: Multi-Attribute Bias Amplification21 Oct 2022
- 2022Robots Enact Malignant Stereotypes23 Jul 2022
- 2022Fairness and Bias in Robot Learning7 Jul 2022
- 2022How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts4 Jul 2022
50 newest of 77 All 77 (JSON)
- 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
- 2021A Survey on Bias in Visual Datasetscited by 84
- 2023FACET: Fairness in Computer Vision Evaluation Benchmarkcited by 58
- 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Biascited by 51
- 2021A Step Toward More Inclusive People Annotations for Fairnesscited by 46
- 2022American == White in Multimodal Language-and-Image AIcited by 39
- 2023T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generationcited by 39
- 2022Quantifying Societal Bias Amplification in Image Captioningcited by 37
- 2022Measuring Representational Harms in Image Captioningcited by 36
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2022Evidence for Hypodescent in Visual Semantic AIcited by 30
- 2022Markedness in Visual Semantic AIcited by 29
12 most cited of 73 All 73 (JSON)
- 2026WIDER-FAIR: An Annotated Version of the WIDER-FACE Dataset for Fairness Evaluation30 Jun 2026
- 2025Privacy Beyond Pixels: Latent Anonymization for Privacy-Preserving Video Understanding11 Nov 2025
- 2025Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent24 Oct 2025
- 2025Emergent AI Surveillance: Overlearned Person Re-Identification and Its Mitigation in Law Enforcement Context7 Oct 2025
- 2025Beyond Overall Accuracy: Pose- and Occlusion-driven Fairness Analysis in Pedestrian Detection for Autonomous Driving30 Sep 2025
- 2025VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysis6 May 2025
- 2025ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition31 Jan 2025
- 2024Pre-training for Action Recognition with Automatically Generated Fractal Datasets26 Nov 2024
- 2024Optimizing importance weighting in the presence of sub-population shifts18 Oct 2024
- 2024Fairness and Bias Mitigation in Computer Vision: A Survey5 Aug 2024
- 2024PathwayBench: Assessing Routability of Pedestrian Pathway Networks Inferred from Multi-City Imagery23 Jul 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
12 newest of 73 All 73 (JSON)