mlsanityData to 14 Oct 2026

Agentopia: Long-Term Life Simulation and Learning in Agent Societies

arXiv 2606.07513 ↗First posted 5 Jun 2026cs.CLcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Humans learn from social life. Simulating this process with LLM-powered agents represents a promising research direction, raising a natural question: whether LLMs can learn from such simulated social experience to better understand and replicate human behavior. However, prior agent society simulations typically operate at the scale of days, limiting the depth of social interactions and long-term growth. In this paper, we study long-term life simulation and LLM learning in agent societies, with two goals: (1) investigating social behaviors that emerge from life-long simulation, and (2) developing anthropomorphic capabilities in LLMs, particularly intelligence in social life, through years of simulated social experience. Specifically, we present Agentopia, a comprehensive framework for long-term life simulation in multi-agent societies, where 100 agents autonomously pursue personal growth, develop social relationships, and fulfill their needs and goals over 10 simulated years. We define life reward to mirror human well-being, and leverage this reward to train LLMs via rejection sampling. Extensive experiments show that agents exhibit rich emergent social behaviors. Furthermore, life reward training effectively enhances the underlying LLM, which leads to improved agent well-being in simulation, and generalizes to downstream role-playing benchmarks with +15.6% improvement.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 14 of its 39 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

14 of 39 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026AIvilization v0: Toward Large-Scale Artificial Social Simulation with a Unified Agent Architecture and Adaptive Agent Profiles11 Feb
  2. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?18 Apr
  3. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation2 Jan

Other references · 11

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  5. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  6. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  7. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
  8. 2026Emotion Concepts and their Function in a Large Language Modelcited by 57
  9. 2024Project Sid: Many-agent simulations toward AI civilizationcited by 49
  10. 2023RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Modelscited by 21
  11. 2026HER: Human-like Reasoning and Reinforcement Learning for LLM Role-playingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning to Make Friends: Coaching LLM Agents toward Emergent Social Ties
  2. 2026Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories
  3. 2026OpenLife: Toward Open-World Artificial Life with Autonomous LLM Agents
  4. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society
  5. 2026SocioVerse2: A Longitudinal Dynamic Social Simulation Framework under a Human-AI Co-evolutionary Paradigm
  6. 2025The Role of Social Learning and Collective Norm Formation in Fostering Cooperation in LLM Multi-Agent Systems
  7. 2026AI Agents Alone Are Not (Yet) Sufficient for Social Simulation
  8. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents