Social Science Is Necessary for Operationalizing Socially Responsible Foundation Models
Not on the map. Why?
Abstract (arXiv)
With the rise of foundation models, there is growing concern about their potential social impacts. Social science has a long history of studying the social impacts of transformative technologies in terms of pre-existing systems of power and how these systems are disrupted or reinforced by new technologies. In this position paper, we build on prior work studying the social impacts of earlier technologies to propose a conceptual framework studying foundation models as sociotechnical systems, incorporating social science expertise to better understand how these models affect systems of power, anticipate the impacts of deploying these models in various applications, and study the effectiveness of technical interventions intended to mitigate social harms. We advocate for an interdisciplinary and collaborative research paradigm between AI and social science across all stages of foundation model research and development to promote socially responsible research practices and use cases, and outline several strategies to facilitate such research.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 104 references that are in the map. First posted on arXiv 20 Dec 2024.
Builds on
30 of 104 references.
References · 30
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023Mistral 7Bcited by 3,065
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2018Model Cards for Model Reportingcited by 1,068
- 2021Ethical and social risks of harm from Language Modelscited by 957
18 more
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 475
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 193
- 2018Learning Gender-Neutral Word Embeddingscited by 169
- 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 127
- 2024Aya 23: Open Weight Releases to Further Multilingual Progresscited by 121
- 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
- 2023Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learningcited by 42
- 2023On Hate Scaling Laws For Data-Swampscited by 28
- 2022Debiasing Methods for Fairer Neural Models in Vision and Language Research: A Surveycited by 22
- 2023The impact of generative artificial intelligence on socioeconomic inequalities and policy makingcited by 20
- 2019Defining AI in Policy versus Practicecited by 15
- 2015First Women, Second Sex: Gender Bias in Wikipediacited by 11
- 2024The Power of Absence: Thinking with Archival Theory in Algorithmic Designcited by 5
- 2024Leveraging Prototypical Representations for Mitigating Social Bias without Demographic Informationcited by 3
- 2021In Oxford Handbook on AI Governance: The Role of Workers in AI Ethics and Governancecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.