EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scales
Not on the map. Why?
Abstract (arXiv)
We argue that multi-agent test-time evolution is not single-agent evolution replicated N times. A single-agent learner can only evolve its own context and memory. A multi-agent system additionally evolves who collaborates, how they collaborate, and how knowledge flows across the population. These components have no single-agent counterpart and can produce phenomena such as emergent specialization. Yet prior test-time methods either confine experiences to individual agents, forfeiting cross-agent learning, or broadcast symmetrically to all agents, erasing the specialization that makes collaboration valuable. We present EVOCHAMBER, a training-free framework that instantiates test-time evolution at three levels over a coevolving agent pool. At its core is CODREAM (Collaborative Dreaming), a post-task protocol triggered on team failure or disagreement, in which agents collaboratively reflect, distill insights, and route them asymmetrically from strong to weak agents on the failed niche, preserving specialization while filling knowledge gaps. Team-level operators assemble niche-conditioned teams and select collaboration structures online. Population-level lifecycle operators fork, merge, prune, and seed agents under performance pressure. On three heterogeneous task streams with Qwen3-8B, EVOCHAMBER reaches 63.9% on competition math, 75.7% on code, and 87.1% on multi-domain reasoning, outperforming the best baseline by 32% relative on math and confirming asymmetric cross-agent transfer as the primary driver in ablation. Starting from several identically initialized agents, four to five stable niche specialists spontaneously emerge, a structural signature of multi-agent evolution that no single-agent learner can express. See our code at: https://github.com/Mercury7353/EvoChamber
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 40 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
37 of 40 references.
References · 37
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
25 more
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2024Automated Design of Agentic Systemscited by 360
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systemscited by 86
- 2025MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learningcited by 80
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 73
- 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
- 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 50
- 2025CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewardscited by 27
- 2025EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memorycited by 6
- 2026MemCollab: Cross-Model Memory Collaboration via Contrastive Trajectory Distillationcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervisioncited by 0
- 2026Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRAcited by 0
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignmentcited by 0
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment29 Sep 2026
- 2026Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA10 Aug 2026
- 2026EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision1 Jun 2026