SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
Not on the map. Why?
Abstract (arXiv)
AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and social sciences. Despite their flexibility, large language models (LLMs) often exhibit systematic bias and miscalibration relative to real human behavior, limiting their reliability. Inspired by synthetic control methods from causal inference, we propose SYN-DIGITS (SYNthetic Control Framework for Calibrated DIGItal Twin Simulation), a principled and lightweight calibration framework that learns latent structure from digital-twin responses and transfers it to align predictions with human ground truth. SYN-DIGITS operates as a post-processing layer on top of any LLM-based simulator and thus is model-agnostic. We develop a latent factor model that formalizes when and why calibration succeeds through latent space alignment conditions, and we systematically evaluate ten calibration methods across thirteen persona constructions, three LLMs, and two datasets. SYN-DIGITS supports both individual-level and distributional simulation for previously unseen questions and unobserved populations, with provable error guarantees. Experiments show that SYN-DIGITS achieves up to 50% relative improvements in individual-level correlation and 50--90% relative reductions in distributional discrepancy compared to uncalibrated baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 58 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
19 of 58 references.
References · 19
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 235
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2014Matrix Completion and Low-Rank SVD via Fast Alternating Least Squarescited by 104
- 2025LLM Generated Persona is a Promise with a Catchcited by 77
- 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 64
- 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 50
- 2021Causal Matrix Completioncited by 45
- 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 35
- 2025Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptionscited by 31
7 more
- 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 26
- 2018The Augmented Synthetic Control Methodcited by 25
- 2025Mixture-of-Personas Language Models for Population Simulationcited by 20
- 2025How Many Human Survey Respondents is a Large Language Model Worth? An Uncertainty Quantification Perspectivecited by 10
- 2022Human Digital Twin: A Surveycited by 7
- 2025Digital Twins as Funhouse Mirrors: Five Key Distortionscited by 7
- 2021Cybonto: Towards Human Cognitive Digital Twins for Cybersecuritycited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Adaptive Querying with AI Persona Priorscited by 0
- 2026LLM-Powered Virtual Population for Demand Simulation and Pricingcited by 0
- 2026LLM-Powered Virtual Population for Demand Simulation and Pricing15 Jun 2026
- 2026Adaptive Querying with AI Persona Priors1 May 2026