mlsanityData to 7 Oct 2026

MiroBench: Benchmarking Realism in Agentic Simulation of Real-world Discussions

arXiv 2606.14715 ↗First posted 10 May 2026cs.MA cs.AI cs.SIcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

LLM agents are increasingly used to simulate real world interactions, but it remains unclear whether simulated behaviors preserve the content patterns and interaction dynamics of real human behaviors. Existing evaluations remain fragmented, which makes it difficult to compare systems or measure progress. In this paper, we focus on Reddit discussions as a concrete first step toward evaluating real-world social simulation. Reddit threads provide public, topic-grounded, multi-party interactions where people share experiences, debate, seek advice, express emotion, and collectively respond to products, events, and social issues. These discussions offer an observable window into broader social behavior, making them a useful setting for testing whether LLM agents can reproduce not only fluent text, but also the distributional patterns and interaction dynamics of real online communities. We introduce MiroBench, a benchmark for Reddit discussion simulation built from 4,292 real Reddit threads. MiroBench uses statistical tests to compare generated and real discussions across four major aspects: repetition and semantic uniformity, narrative content, toxicity and aggression, and structural complexity. Experiments across five domains and five models show that current simulators remain distributionally mismatched with real Reddit threads, while a lightweight prompt-based improvement procedure provides only limited gains. MiroBench offers a concrete benchmark for measuring, diagnosing, and improving realism in LLM-based social simulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 16 of its 24 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

16 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025SoMe: A Realistic Benchmark for LLM-based Social Media Agents9 Dec
  2. 2025SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulation19 Apr
  3. 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulations10 Apr
  4. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
  5. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 11

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  4. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  5. 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agentscited by 89
  6. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 48
  7. 2024Y Social: an LLM-powered Social Media Digital Twincited by 43
  8. 2024A Synthetic Dataset for Personal Attribute Inferencecited by 35
  9. 2024Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learningcited by 19
  10. 2023Where Do People Tell Stories Online? Story Detection Across Online Communitiescited by 16
  11. 2022Characterizing the Structure of Online Conversations Across Redditcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Operational Validation of LLM-Agent Social Simulations: A Replicated Study of a Reddit-like Technology Forum
  2. 2025Towards Simulating Social Influence Dynamics with LLM-based Multi-agents
  3. 2025Don't Trust Generative Agents to Mimic Communication on Social Networks Unless You Benchmarked their Empirical Realism
  4. 2025DEBATE: A Large-Scale Benchmark for Evaluating Opinion Dynamics in Role-Playing LLM Agents
  5. 2026ElecTwit: A Framework for Studying Persuasion in Multi-Agent Social Systems
  6. 2026RealUserSim: Bridging the Reality Gap in Agent Benchmarking via Grounded User Simulation
  7. 2026Social Simulacra in the Wild: AI Agent Communities on Moltbook
  8. 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users