SLALOM: Simulation Lifecycle Analysis via Longitudinal Observation Metrics for Social Simulation
Not on the map. Why?
Abstract (arXiv)
Large Language Model (LLM) agents offer a potentially-transformative path forward for generative social science but face a critical crisis of validity. Current simulation evaluation methodologies suffer from the "stopped clock" problem: they confirm that a simulation reached the correct final outcome while ignoring whether the trajectory leading to it was sociologically plausible. Because the internal reasoning of LLMs is opaque, verifying the "black box" of social mechanisms remains a persistent challenge. In this paper, we introduce SLALOM (Simulation Lifecycle Analysis via Longitudinal Observation Metrics), a framework that shifts validation from outcome verification to process fidelity. Drawing on Pattern-Oriented Modeling (POM), SLALOM treats social phenomena as multivariate time series that must traverse specific SLALOM gates, or intermediate waypoint constraints representing distinct phases. By utilizing Dynamic Time Warping (DTW) to align simulated trajectories with empirical ground truth, SLALOM offers a quantitative metric to assess structural realism, helping to differentiate plausible social dynamics from stochastic noise and contributing to more robust policy simulation standards.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 29 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
3 of 29 references.
References · 3
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents
- 2026SocioVerse2: A Longitudinal Dynamic Social Simulation Framework under a Human-AI Co-evolutionary Paradigm
- 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations
- 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users
- 2026AI Agents Alone Are Not (Yet) Sufficient for Social Simulation
- 2026Social Simulations: from Agent-Based Modeling to Digital Twins
- 2026Stop Drawing Scientific Claims from LLM Social Simulations Without Robustness Audits