Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Not on the map. Why?
Abstract (arXiv)
Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a scoping review of computing research (n=172), we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms - representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms - and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research.
Key facts. Cited by 138 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 13; 2024: 46; 2025: 49; 2026: 29.
138 papers.
Sort:
By area:
- 2024GPT-4o System Cardcited by 4,588
- 2023PaLM 2 Technical Reportcited by 1,162
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
- 2023Auditing large language models: a three-layered approachcited by 137
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 92
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2024Visibility into AI Agentscited by 79
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
- 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applicationscited by 54
- 2025Why human-AI relationships need socioaffective alignmentcited by 47
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
38 more
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 42
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 33
- 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 28
- 2025OpenAI's Approach to External Red Teaming for AI Models and Systemscited by 28
- 2024ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generationcited by 27
- 2024From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agentscited by 25
- 2024SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypescited by 24
- 2025Lessons From Red Teaming 100 Generative AI Productscited by 23
- 2023Summon a Demon and Bind it: A Grounded Theory of LLM Red Teamingcited by 21
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2025Rejected Dialects: Biases Against African American Language in Reward Modelscited by 20
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2024Holistic Safety and Responsibility Evaluations of Advanced AI Modelscited by 19
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harmscited by 19
- 2025Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effectscited by 19
- 2025Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)cited by 19
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2024Beyond Behaviorist Representational Harms: A Plan for Measurement and Mitigationcited by 17
- 2024From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguardscited by 17
- 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
- 2023Safety and Fairness for Content Moderation in Generative Modelscited by 16
- 2023GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectivescited by 16
- 2024Harm Amplification in Text-to-Image Modelscited by 15
- 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataCompcited by 15
- 2024GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Constructioncited by 15
- 2025Taxonomy of User Needs and Actionscited by 15
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religioncited by 14
- 2024Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seekingcited by 13
- 2024Near to Mid-term Risks and Opportunities of Open-Source Generative AIcited by 13
- 2024Acceptable Use Policies for Foundation Modelscited by 12
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitationscited by 11
- 2024Co-designing an AI Impact Assessment Report Template with AI Practitioners and AI Compliance Expertscited by 10
- 2025AI Mismatches: Identifying Potential Algorithmic Harms Before AI Developmentcited by 10
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
- 2024A structured regression approach for evaluating model performance across intersectional subgroupscited by 9
50 most cited of 138 All 138 (JSON)
- 2026Algorithmic Harms Associated with Generative Model-Augmented Recommendation Systems27 Sep 2026
- 2026Agents as Software: A Programming Languages Agenda for Agent Reliability26 Sep 2026
- 2026Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research23 Sep 2026
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026Accurate in space, unreliable in time: how LLMs represent national cultural change1 Sep 2026
- 2026WildSEEK: Evaluating Language Models for Information-Seeking31 Aug 2026
- 2026Abstracted Away: Resisting Alienation and Ungrounded Abstraction in AI Research Communities9 Aug 2026
- 2026Studying People to Study AI: Expert Perspectives on the Epistemic Fit and Barriers of Human Research in AI Safety & Ethics6 Aug 2026
- 2026Investigating Social Bias in Narrative Image Generation3 Aug 2026
- 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems21 Jul 2026
- 2026Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI15 Jul 2026
- 2026Discourse-Aware Policy Analysis with Argumentation: A Hybrid LLM-Symbolic Framework for Disaster Governance14 Jul 2026
38 more
- 2026Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH9 Jul 2026
- 2026Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability7 Jul 2026
- 2026FLARE-AI: Flaw Reporting for AI30 Jun 2026
- 2026Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms26 May 2026
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South18 May 2026
- 2026From Review to Design: Ethical Multimodal Driver Monitoring Systems for Risk Mitigation, Incident Response, and Accountability in Automated Vehicles7 May 2026
- 2026V.O.I.C.E (Voice, Ownership, Identity, Control, Expression): Risk Taxonomy of Synthetic Voice Generation From Empirical Data25 Apr 2026
- 2026Representational Harms in LLM-Generated Narratives Against Global Majority Nationalities24 Apr 2026
- 2026Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems9 Apr 2026
- 2026Interrogating Design Homogenization in Web Vibe Coding13 Mar 2026
- 2026Technically Love: The Evolution of Human-AI Romance Discourse on Reddit9 Mar 2026
- 2026"Better Ask for Forgiveness than Permission": Practices and Policies of AI Disclosure in Freelance Work8 Mar 2026
- 2026Slurry-as-a-Service: A Modest Proposal on Scalable Pluralistic Alignment for Nutrient Optimization2 Mar 2026
- 2026Alignment Is Not Enough: A Relational Framework for Moral Standing in Human-AI Interaction13 Feb 2026
- 2026What is Safety? Corporate Discourse, Power, and the Politics of Generative AI Safety26 Jan 2026
- 2026When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications19 Jan 2026
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safety3 Jan 2026
- 2025Big AI is accelerating the metacrisis: What can we do?31 Dec 2025
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustness22 Dec 2025
- 2025Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation11 Dec 2025
- 2025From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorders4 Dec 2025
- 2025ECHO: A Participatory Framework for Bias-Anchored AI Harm Anticipation27 Nov 2025
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Stories26 Nov 2025
- 2025How Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscape10 Nov 2025
- 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articles24 Oct 2025
- 2025Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AI16 Oct 2025
- 2025Measuring What Matters: Connecting AI Ethics Evaluations to System Attributes, Hazards, and Harms11 Oct 2025
- 2025Taxonomy of User Needs and Actions7 Oct 2025
- 2025ACT: Agentic Classification Tree30 Sep 2025
- 2025Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMs19 Sep 2025
- 2025Datasets for Navigating Sensitive Topics in Recommendation Systems8 Sep 2025
- 2025Who Owns The Robot?: Four Ethical and Socio-technical Questions about Wellbeing Robots in the Real World through Community Engagement1 Sep 2025
- 2025The AI Model Risk Catalog: What Developers and Researchers Miss About Real-World AI Harms21 Aug 2025
- 2025"Accessibility people, you go work on that thing of yours over there": Addressing Disability Inclusion in AI Product Organizations12 Aug 2025
- 2025Towards Experience-Centered AI: A Framework for Integrating Lived Experience in Design and Development9 Aug 2025
- 2025OneShield -- the Next Generation of LLM Guardrails25 Jul 2025
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion22 Jul 2025
- 2025"Just a strange pic": Evaluating 'safety' in GenAI Image safety annotation tasks from diverse annotators' perspectives21 Jul 2025
50 newest of 138 All 138 (JSON)
- 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applicationscited by 54
- 2025OpenAI's Approach to External Red Teaming for AI Models and Systemscited by 28
- 2025Lessons From Red Teaming 100 Generative AI Productscited by 23
- 2023Summon a Demon and Bind it: A Grounded Theory of LLM Red Teamingcited by 21
- 2023GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectivescited by 16
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotatorscited by 8
- 2025Understanding and Mitigating Risks of Generative AI in Financial Servicescited by 4
- 2025OneShield -- the Next Generation of LLM Guardrailscited by 3
- 2025Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMscited by 1
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global Southcited by 1
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustnesscited by 0
- 2025How Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscapecited by 0
- 2026Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South18 May 2026
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustness22 Dec 2025
- 2025How Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscape10 Nov 2025
- 2025Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMs19 Sep 2025
- 2025OneShield -- the Next Generation of LLM Guardrails25 Jul 2025
- 2025Understanding and Mitigating Risks of Generative AI in Financial Services25 Apr 2025
- 2025OpenAI's Approach to External Red Teaming for AI Models and Systems24 Jan 2025
- 2025Lessons From Red Teaming 100 Generative AI Products13 Jan 2025
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators6 Nov 2024
- 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications14 Nov 2023
- 2023Summon a Demon and Bind it: A Grounded Theory of LLM Red Teaming10 Nov 2023
- 2023GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives9 Nov 2023
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 42
- 2025Rejected Dialects: Biases Against African American Language in Reward Modelscited by 20
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitationscited by 11
- 2026Slurry-as-a-Service: A Modest Proposal on Scalable Pluralistic Alignment for Nutrient Optimizationcited by 0
- 2026Slurry-as-a-Service: A Modest Proposal on Scalable Pluralistic Alignment for Nutrient Optimization2 Mar 2026
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications21 Mar 2025
- 2025Rejected Dialects: Biases Against African American Language in Reward Models18 Feb 2025
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitations26 Jun 2024
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback9 Mar 2023
- 2025ACT: Agentic Classification Treecited by 1
- 2025ACT: Agentic Classification Tree30 Sep 2025
- 2024GPT-4o System Cardcited by 4,588
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
- 2023Auditing large language models: a three-layered approachcited by 137
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 92
- 2024Visibility into AI Agentscited by 79
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
- 2025Why human-AI relationships need socioaffective alignmentcited by 47
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 33
- 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
12 most cited of 117 All 117 (JSON)
- 2026Algorithmic Harms Associated with Generative Model-Augmented Recommendation Systems27 Sep 2026
- 2026Agents as Software: A Programming Languages Agenda for Agent Reliability26 Sep 2026
- 2026Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research23 Sep 2026
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026Accurate in space, unreliable in time: how LLMs represent national cultural change1 Sep 2026
- 2026WildSEEK: Evaluating Language Models for Information-Seeking31 Aug 2026
- 2026Abstracted Away: Resisting Alienation and Ungrounded Abstraction in AI Research Communities9 Aug 2026
- 2026Studying People to Study AI: Expert Perspectives on the Epistemic Fit and Barriers of Human Research in AI Safety & Ethics6 Aug 2026
- 2026Investigating Social Bias in Narrative Image Generation3 Aug 2026
- 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems21 Jul 2026
- 2026Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI15 Jul 2026
- 2026Discourse-Aware Policy Analysis with Argumentation: A Hybrid LLM-Symbolic Framework for Disaster Governance14 Jul 2026
12 newest of 117 All 117 (JSON)