mlsanityData to 13 Oct 2026

LLMs generate structurally realistic social networks but overestimate political homophily

arXiv 2408.16629 ↗First posted 29 Aug 2024cs.CY cs.AI cs.SIcited by 32

Not on the map. Why?

Abstract (arXiv)

Generating social networks is essential for many applications, such as epidemic modeling and social simulations. The emergence of generative AI, especially large language models (LLMs), offers new possibilities for social network generation: LLMs can generate networks without additional training or need to define network parameters, and users can flexibly define individuals in the network using natural language. However, this potential raises two critical questions: 1) are the social networks generated by LLMs realistic, and 2) what are risks of bias, given the importance of demographics in forming social ties? To answer these questions, we develop three prompting methods for network generation and compare the generated networks to a suite of real social networks. We find that more realistic networks are generated with "local" methods, where the LLM constructs relations for one persona at a time, compared to "global" methods that construct the entire network at once. We also find that the generated networks match real networks on many characteristics, including density, clustering, connectivity, and degree distribution. However, we find that LLMs emphasize political homophily over all other types of homophily and significantly overestimate political homophily compared to real social networks.

Key facts. Cited by 32 papers in the map (data through 13 Oct 2026). Builds on 35 of its 95 references that are in the map. First posted on arXiv 29 Aug 2024.

Builds on

35 of 95 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,320
  2. 2023GPT-4 Technical Reportcited by 18,278
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,541
  5. 2018Datasheets for Datasetscited by 1,377
  6. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 908
  7. 2023Whose Opinions Do Language Models Reflect?cited by 768
  8. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 747
  9. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 666
  10. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 512
  11. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 410
  12. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 390
23 more
  1. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 378
  2. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  3. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 357
  4. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  5. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 273
  6. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 250
  7. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 230
  8. 2023Language is All a Graph Needscited by 219
  9. 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 205
  10. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 196
  11. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 191
  12. 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 188
  13. 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
  14. 2017Cooperative Game Theory Approaches for Network Partitioningcited by 134
  15. 2023GraphText: Graph Reasoning in Text Spacecited by 110
  16. 2024Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Modelscited by 105
  17. 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 96
  18. 2020A Systematic Survey on Deep Generative Models for Graph Generationcited by 94
  19. 2023A Survey of Graph Meets Large Language Model: Progress and Future Directionscited by 84
  20. 2024Network Formation and Dynamics Among Multi-LLMscited by 28
  21. 2017A Long-Term Analysis of Polarization on Twittercited by 17
  22. 2024Exploring the Potential of Large Language Models in Graph Generationcited by 15
  23. 2014Synthetic Generation of Social Network Data With Endorsementscited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 4; 2025: 12; 2026: 16.

32 papers.

Sort:

By area:

  1. 2025LLM Generated Persona is a Promise with a Catchcited by 79
  2. 2025Emergence of polarization in networks of large language model agentscited by 26
  3. 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulationscited by 26
  4. 2025Can A Society of Generative Agents Simulate Human Behavior and Inform Public Health Policy? A Case Study on Vaccine Hesitancycited by 16
  5. 2024Social Opinions Prediction Utilizes Fusing Dynamics Equation with LLM-based Agentscited by 11
  6. 2024LLM-Based Multi-Agent Systems are Scalable Graph Generative Modelscited by 11
  7. 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Sciencecited by 9
  8. 2025Are LLM-Powered Social Media Bots Realistic?cited by 7
  9. 2026The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Modelscited by 7
  10. 2025Don't Trust Generative Agents to Mimic Communication on Social Networks Unless You Benchmarked their Empirical Realismcited by 6
  11. 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacycited by 5
  12. 2025Learning to Make Friends: Coaching LLM Agents toward Emergent Social Tiescited by 5
20 more
  1. 2026Gender Dynamics and Homophily in a Social Network of LLM Agentscited by 5
  2. 2026Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibilitycited by 5
  3. 2025Simulating and Experimenting with Social Media Mobilization Using LLM Agentscited by 3
  4. 2025Love First, Know Later: Persona-Based Romantic Compatibility Through LLM Text World Enginescited by 3
  5. 2026An Empirical Study of Collective Behaviors and Social Dynamics in Large Language Model Agentscited by 2
  6. 2024DynaGRAG | Exploring the Topology of Information for Advancing Language Understanding and Generation in Graph Retrieval-Augmented Generationcited by 1
  7. 2025Free Lunch for User Experience: Crowdsourcing Agents for Scalable User Studiescited by 1
  8. 2026HAG: Hierarchical Demographic Tree-based Agent Generation for Topic-Adaptive Simulationcited by 1
  9. 2026When Do LLMs Generate Realistic Social Networks? A Multi-Dimensional Study of Culture, Language, Scale, and Methodcited by 1
  10. 2025Leveraging Interview-Informed LLMs to Model Survey Responses: Comparative Insights from AI-Generated and Human Datacited by 0
  11. 2026Large language models for spreading dynamics in complex systemscited by 0
  12. 2026Causal Effects with Unobserved Unit Types in Interacting Human-AI Systemscited by 0
  13. 2026Collective Opinion Dynamics in Structured LLM Populationscited by 0
  14. 2026Can LLM Agents Simulate Dynamic Networks? A Case Study on Email Networks with Phishing Synthesiscited by 0
  15. 2026Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scalecited by 0
  16. 2026Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.1cited by 0
  17. 2026Persuasive and Compliant Tendencies Predict Group Decision-Making in Humans and Language Modelscited by 0
  18. 2026LLMs for Social Network Modeling: From Network Generation to Dynamic Processescited by 0
  19. 2026Interpreting and Steering LLM Agents for Social Simulationscited by 0
  20. 2026Data-Driven Personas for Survey Simulation: Insights into Simulation Alignment Across Data-Access Regimescited by 0