Measuring the Behavioral Fidelity of Long-Horizon Human Activity Simulations
Not on the map. Why?
Abstract (arXiv)
As LLM-based human simulators are increasingly used for policy, evaluation, and training, they must faithfully reproduce real behavioral patterns. While prior work has examined behavioral fidelity in survey responses and dialogue, longer-horizon real-world activity remains largely unexplored. We introduce a framework for evaluating behavioral fidelity in long-horizon activity simulations across temporal granularities and levels of analysis. As a case study, we collect a 43-hour multi-camera dataset of in-the-wild office activity and compare trace-derived conditioning mechanisms: persona descriptors, few-shot exemplars, and statistical transition and time-of-day priors. We find that behavioral fidelity is not uniform across metrics: statistical priors bring activity and sequence distributions closest to real behavior, yet over-fragment routines and suppress within-person variability. These findings motivate a more holistic evaluation that spans multiple metrics, temporal granularities, and levels of analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 44 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
24 of 44 references.
References · 24
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2023Do LLMs exhibit human-like response biases? A case study in survey designcited by 180
- 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
- 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 57
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
12 more
- 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 39
- 2024Simulating Human-like Daily Activities with Desire-driven Autonomycited by 30
- 2025CitySim: Modeling Urban Behaviors and City Dynamics with Large-Scale LLM-Driven Agent Simulationcited by 28
- 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 22
- 2024Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Dialoguecited by 16
- 2025The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understandingcited by 16
- 2026Quantifying the Utility of User Simulators for Building Collaborative LLM Assistantscited by 10
- 2025Human vs. Agent in Task-Oriented Conversationscited by 9
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Tracescited by 9
- 2026Measuring and Mitigating the Distributional Gap Between Real and Simulated User Behaviorscited by 6
- 2026WhatIf: Interactive Exploration of LLM-Powered Social Simulations for Policy Reasoningcited by 3
- 2026OrganicHAR: Towards Activity Discovery in Organic Settings for Privacy Preserving Sensors Using Efficient Video Analysiscited by 2
Built on by
Not cited yet.