SAGE: A Quantitative Evaluation of Socialized Evolution in Agent Ecosystems
Not on the map. Why?
Abstract (arXiv)
Self-improving language agents are typically evaluated in isolation: an agent attempts a task, receives feedback, and iteratively refines its own behavior. Yet agents increasingly operate alongside peers whose strategies and outcomes are publicly visible. This raises an under-studied question: when does shared experience produce improvements that self-improvement alone cannot achieve? We introduce SAGE (Social Agent Group Evolution),an evaluation framework that compares two compute-matched conditions: SocialEvo, where agents from five distinct model families co-evolve with access to all peers' histories; and SelfEvo, where each agent receives the same number of task attempts but sees only its own past, which is conventional in self-improving agent studies. We instantiate SAGE in three arenas: open-ended ML research, long-horizon economic planning, and strategic multiplayer play, evaluated across multiple evolutionary rounds. We find that group history is not a universal amplifier: the strongest agent does not exceed its self-evolution ceiling. However, agents that plateau under self-improvement can achieve significant breakthroughs when peer experience is available. In competitive settings, counterfactual controls reveal that agents improve generally rather than developing opponent-specific strategies. Across different forms of shared history, filtered peer traces and reflective summaries often outperform raw logs, indicating that social gains depend on abstraction rather than exposure volume. These findings reveal that peer-history gains are agent-specific, arena-dependent, and contingent on the capacity to abstract transferable knowledge from public traces.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
36 of 49 references.
References · 36
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2017Population Based Training of Neural Networkscited by 367
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
24 more
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 313
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 175
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 124
- 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluationscited by 120
- 2026Learning to Discover at Test Timecited by 115
- 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 101
- 2015The Ladder: A Reliable Leaderboard for Machine Learning Competitionscited by 69
- 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Researchcited by 64
- 2025Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial?cited by 54
- 2024NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surroundingcited by 51
- 2020Emergent Social Learning via Multi-agent Reinforcement Learningcited by 44
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 36
- 2025MLRC-Bench: Can Language Agents Solve Machine Learning Research Challenges?cited by 28
- 2024Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarioscited by 23
- 2025GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignmentcited by 21
- 2025Agents of Change: Self-Evolving LLM Agents for Strategic Planningcited by 21
- 2026COMI: Coarse-to-fine Context Compression via Marginal Information Gaincited by 13
- 2025Evaluating Generalization Capabilities of LLM-Based Agents in Mixed-Motive Scenarios Using Concordiacited by 12
- 2026Read As Human: Compressing Context via Parallelizable Close Reading and Skimmingcited by 10
- 2025CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournamentscited by 5
- 2026Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Drivencited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Evolve Together, Fall into Place: How Social Scaffolding Shapes Self-Evolving Multi-Agent Systems
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
- 2026From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMs
- 2026Large Language Model Agents Are Not Always Faithful Self-Evolvers
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026SODE: Analyzing Social Dynamics in LLM Agents
- 2026Experience-Sensitive Game Learning: A Behavioral Study of Humans and Language Agents
- 2026Evolving Deception: When Agents Evolve, Deception Wins