Unpacking the Expressed Consequences of AI Research in Broader Impact Statements
Not on the map. Why?
Abstract (arXiv)
The computer science research community and the broader public have become increasingly aware of negative consequences of algorithmic systems. In response, the top-tier Neural Information Processing Systems (NeurIPS) conference for machine learning and artificial intelligence research required that authors include a statement of broader impact to reflect on potential positive and negative consequences of their work. We present the results of a qualitative thematic analysis of a sample of statements written for the 2020 conference. The themes we identify broadly fall into categories related to how consequences are expressed (e.g., valence, specificity, uncertainty), areas of impacts expressed (e.g., bias, the environment, labor, privacy), and researchers' recommendations for mitigating negative consequences in the future. In light of our results, we offer perspectives on how the broader impact statement can be implemented in future iterations to better align with potential goals.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 May 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 3; 2024: 5; 2025: 4.
22 papers.
Sort:
By area:
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 78
- 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Researchcited by 20
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statementscited by 16
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 12
- 2023Responsible AI Research Needs Impact Statements Toocited by 7
10 more
- 2024BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologiescited by 6
- 2021Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practicescited by 3
- 2023Responsible AI Considerations in Text Summarization Research: A Review of Current Practicescited by 2
- 2024A Systematic Review of NeurIPS Dataset Management Practicescited by 2
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Makingcited by 2
- 2021Addressing Privacy Threats from Machine Learningcited by 1
- 2022Don't "research fast and break things": On the ethics of Computational Social Sciencecited by 0
- 2024Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessmentcited by 0
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Researchcited by 0
- 2025Societal AI Research Has Become Less Interdisciplinarycited by 0
- 2025Societal AI Research Has Become Less Interdisciplinary10 Jun 2025
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Research10 Jun 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review22 Jan 2025
- 2024A Systematic Review of NeurIPS Dataset Management Practices31 Oct 2024
- 2024BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies10 May 2024
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM18 Apr 2024
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping23 Feb 2024
- 2024Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessment31 Jan 2024
- 2023Responsible AI Research Needs Impact Statements Too20 Nov 2023
- 2023Responsible AI Considerations in Text Summarization Research: A Review of Current Practices18 Nov 2023
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Review7 Jul 2023
10 more
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey10 Nov 2022
- 2022Don't "research fast and break things": On the ethics of Computational Social Science12 Jun 2022
- 2022How Different Groups Prioritize Ethical Values for Responsible AI16 May 2022
- 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research5 May 2022
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethics11 Apr 2022
- 2022Challenges and Strategies in Cross-Cultural NLP18 Mar 2022
- 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statements2 Nov 2021
- 2021Addressing Privacy Threats from Machine Learning25 Oct 2021
- 2021The Values Encoded in Machine Learning Research29 Jun 2021
- 2021Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practices2 Jun 2021
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 78
- 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Researchcited by 20
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
- 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statementscited by 16
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 12
- 2023Responsible AI Research Needs Impact Statements Toocited by 7
12 most cited of 21 All 21 (JSON)
- 2025Societal AI Research Has Become Less Interdisciplinary10 Jun 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review22 Jan 2025
- 2024A Systematic Review of NeurIPS Dataset Management Practices31 Oct 2024
- 2024BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies10 May 2024
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM18 Apr 2024
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping23 Feb 2024
- 2024Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessment31 Jan 2024
- 2023Responsible AI Research Needs Impact Statements Too20 Nov 2023
- 2023Responsible AI Considerations in Text Summarization Research: A Review of Current Practices18 Nov 2023
- 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Review7 Jul 2023
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Survey10 Nov 2022
12 newest of 21 All 21 (JSON)