Graph-Based Alternatives to LLMs for Human Simulation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have become a popular approach for simulating human behaviors, yet it remains unclear if LLMs are necessary for all simulation tasks. We study a broad family of close-ended simulation tasks, with applications from survey prediction to test-taking, and show that a graph neural network can match or surpass strong LLM-based methods. We introduce Graph-basEd Models for Human Simulation (GEMS) which formulates close-ended simulation as link prediction on a heterogeneous graph of individuals and choices. Across three datasets and three evaluation settings, GEMS matches or outperforms the strongest LLM-based methods while using three orders of magnitude fewer parameters. These results suggest that graph-based modeling can complement LLMs as an efficient and transparent approach to simulating human behaviors. Code is available at https://github.com/schang-lab/gems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 59 of its 87 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
59 of 87 references.
References · 59
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017Graph Attention Networkscited by 8,923
- 2025Qwen3 Technical Reportcited by 8,820
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2016Layer Normalizationcited by 5,669
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
38 more
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2019Neural Graph Collaborative Filteringcited by 661
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 343
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2023Linear Representations of Sentiment in Large Language Modelscited by 163
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
- 2023Aligning Language Models to User Opinionscited by 99
- 2025LLM Social Simulations Are a Promising Research Methodcited by 99
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 97
- 2025LLM Generated Persona is a Promise with a Catchcited by 81
- 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 66
- 2020Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 64
- 2021TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Searchcited by 54
- 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 53
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 51
- 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 39
- 2024Few-shot Personalization of LLMs with Mis-aligned Responsescited by 32
- 2023Language Models Trained on Media Diets Can Predict Public Opinioncited by 30
- 2024Unveiling the Spectrum of Data Contamination in Language Models: A Survey from Detection to Remediationcited by 30
- 2025Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questionscited by 22
- 2024Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learningcited by 21
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.