mlsanityData to 7 Oct 2026

Rolling in the deep of cognitive and AI biases

arXiv 2407.21202 ↗First posted 30 Jul 2024cs.AI cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

Nowadays, we delegate many of our decisions to Artificial Intelligence (AI) that acts either in solo or as a human companion in decisions made to support several sensitive domains, like healthcare, financial services and law enforcement. AI systems, even carefully designed to be fair, are heavily criticized for delivering misjudged and discriminated outcomes against individuals and groups. Numerous work on AI algorithmic fairness is devoted on Machine Learning pipelines which address biases and quantify fairness under a pure computational view. However, the continuous unfair and unjust AI outcomes, indicate that there is urgent need to understand AI as a sociotechnical system, inseparable from the conditions in which it is designed, developed and deployed. Although, the synergy of humans and machines seems imperative to make AI work, the significant impact of human and societal factors on AI bias is currently overlooked. We address this critical issue by following a radical new methodology under which human cognitive biases become core entities in our AI fairness overview. Inspired by the cognitive science definition and taxonomy of human heuristics, we identify how harmful human actions influence the overall AI lifecycle, and reveal human to AI biases hidden pathways. We introduce a new mapping, which justifies the human heuristics to AI biases reflections and we detect relevant fairness intensities and inter-dependencies. We envision that this approach will contribute in revisiting AI fairness under deeper human-centric case studies, revealing hidden biases cause and effects.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 73 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

20 of 73 references.

References · 20

  1. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  2. 2014Certifying and removing disparate impactcited by 715
  3. 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
  4. 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
  5. 2020Characterising Bias in Compressed Modelscited by 162
  6. 2018The Measure and Mismeasure of Fairnesscited by 94
  7. 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 83
  8. 2023Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedbackcited by 78
  9. 2020Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingcited by 59
  10. 2024Fairness in Large Language Models: A Taxonomic Surveycited by 57
  11. 2023Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Biascited by 51
  12. 2023Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystemcited by 49
8 more
  1. 2023A Critical Survey on Fairness Benefits of Explainable AIcited by 16
  2. 2024The Pursuit of Fairness in Artificial Intelligence Models: A Surveycited by 13
  3. 2022Inherent Limitations of AI Fairnesscited by 12
  4. 2023The Butterfly Effect in Artificial Intelligence Systems: Implications for AI Bias and Fairnesscited by 12
  5. 2017Cognitive Biases in Software Engineering: A Systematic Mapping Studycited by 9
  6. 2015The mRMR variable selection method: a comparative study for functional datacited by 5
  7. 2021An Introduction to Algorithmic Fairnesscited by 4
  8. 2023SoK: Taming the Triangle -- On the Interplays between Fairness, Interpretability and Privacy in Machine Learningcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.