Yunjue Agent Tech Report: A Fully Reproducible, Zero-Start In-Situ Self-Evolving Agent System for Open-Ended Tasks
Not on the map. Why?
Abstract (arXiv)
Conventional agent systems often struggle in open-ended environments where task distributions continuously drift and external supervision is scarce. Their reliance on static toolsets or offline training lags behind these dynamics, leaving the system's capability boundaries rigid and unknown. To address this, we propose the In-Situ Self-Evolving paradigm. This approach treats sequential task interactions as a continuous stream of experience, enabling the system to distill short-term execution feedback into long-term, reusable capabilities without access to ground-truth labels. Within this framework, we identify tool evolution as the critical pathway for capability expansion, which provides verifiable, binary feedback signals. Within this framework, we develop Yunjue Agent, a system that iteratively synthesizes, optimizes, and reuses tools to navigate emerging challenges. To optimize evolutionary efficiency, we further introduce a Parallel Batch Evolution strategy. Empirical evaluations across five diverse benchmarks under a zero-start setting demonstrate significant performance gains over proprietary baselines. Additionally, complementary warm-start evaluations confirm that the accumulated general knowledge can be seamlessly transferred to novel domains. Finally, we propose a novel metric to monitor evolution convergence, serving as a function analogous to training loss in conventional optimization. We open-source our codebase, system traces, and evolved tools to facilitate future research in resilient, self-evolving intelligence.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 32 of its 82 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
32 of 82 references.
References · 32
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2025Humanity's Last Examcited by 491
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024Agent Workflow Memorycited by 383
- 2023Tool Learning with Foundation Modelscited by 302
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
- 2024Theoretical guarantees on the best-of-n alignment policycited by 124
20 more
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 95
- 2024A Survey on Self-Evolution of Large Language Modelscited by 91
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2025Agent Learning via Early Experiencecited by 85
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsetscited by 71
- 2025Self-Challenging Language Model Agentscited by 59
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 50
- 2025VisPlay: Self-Evolving Vision-Language Models from Imagescited by 47
- 2025Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmarkcited by 45
- 2025Self-Improving LLM Agents at Test-Timecited by 30
- 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoningcited by 27
- 2024The Open Source Advantage in Large Language Models (LLMs)cited by 18
- 2025Multi-Agent Deep Research: Training Multi-Agent Systems with M-GRPOcited by 18
- 2026Beyond Static Tools: Test-Time Tool Evolution for Scientific Reasoningcited by 15
- 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 13
- 2025Alita-G: Self-Evolving Generative Agent for Agent Generationcited by 10
- 2025MathSE: Improving Multimodal Mathematical Reasoning via Self-Evolving Iterative Reflection and Reward-Guided Fine-Tuningcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 128
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agentscited by 34
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Metis: Bridging Text and Code Memory for Self-Evolving Agentscited by 2
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agentscited by 0
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents12 Oct 2026
- 2026Metis: Bridging Text and Code Memory for Self-Evolving Agents23 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents28 May 2026
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr 2026