mlsanityData to 14 Oct 2026

Hybrid Open-Ended Tri-Evolution Makes Better Deep Researcher

arXiv 2606.13710 ↗First posted 10 Jun 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep research and agent evolution serve as de-facto tasks for AI agents in real-world applications toward artificial general intelligence. The former enables autonomous retrieval and integration of information in open-ended environments to tackle open-ended research tasks, yet it is constrained by the static parametric deep research capabilities of agent systems. The latter allows agents to autonomously interact with the environment to gain experiences that evolve model capabilities. However, its effectiveness has been widely validated only on verifiable tasks with standard answers, leaving a gap with open-ended research tasks. To bridge these two critical tasks, we propose the Hybrid Open-Ended Tri-Evolution (HOTE) framework, which leverages hybrid-mode reinforcement learning to facilitate the collaborative evolution of a proposer, solver and judge based on web-scale knowledge, moving toward autonomous evolving agents in open-ended tasks and environments. Extensive experiments on three long-form deep research benchmarks demonstrate that the 8B model trained via HOTE surpasses the strongest static open 8-32B models as well as those trained by state-of-the-art deep research training methods with less time overhead, and further verify that the evolution of all three modules in HOTE is indispensable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

20 of 31 references.

References · 20

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  3. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  4. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
  5. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  6. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  7. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  8. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
  9. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 241
  10. 2024Self-Play Preference Optimization for Language Model Alignmentcited by 232
  11. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  12. 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
8 more
  1. 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 128
  2. 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
  3. 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 83
  4. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
  5. 2025ResearchQA: Evaluating Scholarly Question Answering at Scale Across 75 Fields with Survey-Mined Questions and Rubricscited by 49
  6. 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 44
  7. 2025Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Datasetcited by 38
  8. 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verificationcited by 22

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MetaResearcher: Scaling Deep Research via Self-Reflective Reinforcement Learning in Adversarial Virtual Environments
  2. 2026Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
  3. 2025Rethinking the Design of Reinforcement Learning-Based Deep Research Agents
  4. 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery
  5. 2026RLDISCOVER: LLM-driven co-evolution of reinforcement learning algorithms
  6. 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing
  7. 2025MARS: Co-evolving Dual-System Deep Research via Multi-Agent Reinforcement Learning
  8. 2026O-Researcher: An Open Ended Deep Research Model via Multi-Agent Distillation and Agentic RL