mlsanityData to 7 Oct 2026

AI for social science and social science of AI: A Survey

arXiv 2401.11839 ↗First posted 22 Jan 2024cs.CL cs.CYcited by 29

Not on the map. Why?

Abstract (arXiv)

Recent advancements in artificial intelligence, particularly with the emergence of large language models (LLMs), have sparked a rethinking of artificial general intelligence possibilities. The increasing human-like capabilities of AI are also attracting attention in social science research, leading to various studies exploring the combination of these two fields. In this survey, we systematically categorize previous explorations in the combination of AI and social science into two directions that share common technical approaches but differ in their research objectives. The first direction is focused on AI for social science, where AI is utilized as a powerful tool to enhance various stages of social science research. While the second direction is the social science of AI, which examines AI agents as social entities with their human-like cognitive and linguistic capabilities. By conducting a thorough review, particularly on the substantial progress facilitated by recent advancements in large language models, this paper introduces a fresh perspective to reassess the relationship between AI and social science, provides a cohesive framework that allows researchers to understand the distinctions and connections between AI for social science and social science of AI, and also summarized state-of-art experiment simulation platforms to facilitate research in these two directions. We believe that as AI technology continues to advance and intelligent agents find increasing applications in our daily lives, the significance of the combination of AI and social science will become even more prominent.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 62 of its 148 references that are in the map. First posted on arXiv 22 Jan 2024.

Builds on

62 of 148 references.

References · 62

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  8. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  9. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  10. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  11. 2023Whose Opinions Do Language Models Reflect?cited by 759
  12. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
38 more
  1. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  2. 2022Using cognitive psychology to understand GPT-3cited by 389
  3. 2018AI safety via debatecited by 384
  4. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  5. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  6. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
  7. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  8. 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
  9. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  10. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  11. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
  12. 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
  13. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  14. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 165
  15. 2022Language Models as Agent Modelscited by 131
  16. 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 125
  17. 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
  18. 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
  19. 2022Capturing Failures of Large Language Models via Human Cognitive Biasescited by 97
  20. 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
  21. 2019Dreaddit: A Reddit Dataset for Stress Analysis in Social Mediacited by 81
  22. 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
  23. 2022FLUTE: Figurative Language Understanding through Textual Explanationscited by 78
  24. 2022How would Stance Detection Techniques Evolve after the Launch of ChatGPT?cited by 76
  25. 2021Mitigating Political Bias in Language Models Through Reinforced Calibrationcited by 73
  26. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
  27. 2023The Self-Perception and Political Biases of ChatGPTcited by 66
  28. 2022Putting GPT-3's Creativity to the (Alternative Uses) Testcited by 62
  29. 2022Do Large Language Models know what humans know?cited by 60
  30. 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
  31. 2022Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning taskscited by 56
  32. 2023Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?cited by 54
  33. 2023Evaluation of ChatGPT for NLP-based Mental Health Applicationscited by 53
  34. 2022CommunityLM: Probing Partisan Worldviews from Language Modelscited by 36
  35. 2021Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlinescited by 32
  36. 2023Mind meets machine: Unravelling GPT-4's cognitive psychologycited by 31
  37. 2023Language Models Trained on Media Diets Can Predict Public Opinioncited by 30
  38. 2022Evaluating Psychological Safety of Large Language Modelscited by 26

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 11; 2026: 7.

29 papers.

Sort:

By area:

  1. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  2. 2024Can Large Language Model Agents Simulate Human Trust Behavior?cited by 62
  3. 2024Knowledge Mechanisms in Large Language Models: A Survey and Perspectivecited by 50
  4. 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 41
  5. 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
  6. 2024Designing AI-Agents with Personalities: A Psychometric Approachcited by 14
  7. 2024Preemptive Detection and Correction of Misaligned Actions in LLM Agentscited by 9
  8. 2025From Prompts to Constructs: A Dual-Validity Framework for Large Language Model Research in Psychologycited by 9
  9. 2025A Survey of AI Scientistscited by 9
  10. 2024Can Large Language Models Replace Human Subjects? A Large-Scale Replication of Scenario-Based Experiments in Psychology and Managementcited by 5
  11. 2026Gender Dynamics and Homophily in a Social Network of LLM Agentscited by 5
  12. 2024Bridging AI and Science: Implications from a Large-Scale Literature Analysis of AI4Sciencecited by 3
17 more
  1. 2025Evaluating the Simulation of Human Personality-Driven Susceptibility to Misinformation with LLMscited by 3
  2. 2026AI Agents as Policymakers in Simulated Epidemicscited by 3
  3. 2025Dataset Featurization: Uncovering Natural Language Features through Unsupervised Data Reconstructioncited by 2
  4. 2024Intelligent Computing Social Modeling and Methodological Innovations in Political Science in the Era of Large Language Modelscited by 1
  5. 2025Arti-"fickle" Intelligence: Using LLMs as a Tool for Inference in the Political and Social Sciencescited by 1
  6. 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studiescited by 1
  7. 2026Normative Common Ground Replication (NormCoRe): Replication-by-Translation for Studying Norms in Multi-Agent AIcited by 1
  8. 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detectioncited by 0
  9. 2024AI-Empowered Human Research Integrating Brain Science and Social Sciences Insightscited by 0
  10. 2025Random Forest-of-Thoughts: Uncertainty-aware Reasoning for Computational Social Sciencecited by 0
  11. 2025e-person Architecture and Framework for Human-AI Co-adventure Relationshipcited by 0
  12. 2025Text-to-Image Models and Their Representation of People from Different Nationalities Engaging in Activitiescited by 0
  13. 2025Epitome: Pioneering an Experimental Platform for AI-Social Science Integrationcited by 0
  14. 2026EduResearchBench: A Hierarchical Atomic Task Decomposition Benchmark for Full-Lifecycle Educational Researchcited by 0
  15. 2026A Simulation-Based Method for Testing Collaborative Learning Scaffolds Using LLM-Based Multi-Agent Systemscited by 0
  16. 2026Taking a Pulse on How Generative AI is Reshaping the Software Engineering Research Landscapecited by 0
  17. 2026BenCSSmark: Making the Social Sciences Count in LLM Researchcited by 0