Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second, multi-agent pipelines often dilute strong solutions by averaging across all candidates. We address these challenges with a unified framework that combines implicit retrieval and structured collaboration. At its foundation, a Monitor-based retrieval module operates at the token level, integrating external knowledge with minimal disruption to reasoning. On top of this substrate, Hierarchical Solution Refinement (HSR) iteratively designates each candidate as an anchor to be repaired by its peers, while Quality-Aware Iterative Reasoning (QAIR) adapts refinement to solution quality. On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3% accuracy - the highest reported to date, surpassing the strongest agent baseline by 13.4 points and leading frontier LLMs by up to 18.1 points, while simultaneously reducing token usage by 53.5% and agent steps by 43.7%. Results on SuperGPQA and TRQA confirm robustness across domains. Error analysis shows that reasoning failures and knowledge gaps co-occur in over 85% of cases, while diversity analysis reveals a clear dichotomy: retrieval tasks benefit from solution variety, whereas reasoning tasks favor consensus. Together, these findings demonstrate how implicit augmentation and structured refinement overcome the inefficiencies of explicit tool use and uniform aggregation. The code is available at https://github.com/tangxiangru/Eigen-1.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 59 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
33 of 59 references.
Closest ancestors · 3
Same direction, newest first
- 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation8 Mar
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 30
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2025Humanity's Last Examcited by 491
- 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 369
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
18 more
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 108
- 2025SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplinescited by 79
- 2023Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generationcited by 74
- 2024DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Modelscited by 63
- 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
- 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocolcited by 39
- 2025Table-Critic: A Multi-Agent Framework for Collaborative Criticism and Refinement in Table Reasoningcited by 32
- 2024CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solvingcited by 31
- 2025HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generationcited by 31
- 2024OpenDataLab: Empowering General Artificial Intelligence with Open Datasetscited by 29
- 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoningcited by 27
- 2025HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM Systemscited by 13
- 2025Enhancing Multi-Agent Systems via Reinforcement Learning with LLM-based Planner and Graph-based Policycited by 12
- 2025How to Train a Leader: Hierarchical Reasoning in Multi-Agent LLMscited by 12
- 2024Towards Collaborative Intelligence: Propagating Intentions and Reasoning for Multi-Agent Coordination with Large Language Modelscited by 10
Built on by
Citing papers per year: 2025: 1; 2026: 10.
11 papers.
- 2026From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agentscited by 21
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 11
- 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repaircited by 6
- 2026ReThinker: Scientific Reasoning by Rethinking with Guided Reflection and Confidence Controlcited by 4
- 2026AceGRPO: Adaptive Curriculum Enhanced Group Relative Policy Optimization for Autonomous Machine Learning Engineeringcited by 4
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
- 2026SCI-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verificationcited by 2
- 2026Auto-Configuring Scientific Simulators with Lightweight Coding-Agent Adapterscited by 2
- 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoningcited by 1
- 2026When LLMs Read Tables Carelessly: Measuring and Reducing Data Referencing Errorscited by 1
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoningcited by 0
- 2026When LLMs Read Tables Carelessly: Measuring and Reducing Data Referencing Errors30 Jun 2026
- 2026Auto-Configuring Scientific Simulators with Lightweight Coding-Agent Adapters8 Jun 2026
- 2026SCI-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verification3 Jun 2026
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents18 May 2026
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoning11 May 2026
- 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning2 May 2026
- 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repair5 Mar 2026
- 2026AceGRPO: Adaptive Curriculum Enhanced Group Relative Policy Optimization for Autonomous Machine Learning Engineering8 Feb 2026
- 2026ReThinker: Scientific Reasoning by Rethinking with Guided Reflection and Confidence Control4 Feb 2026
- 2026From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agents30 Jan 2026
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence26 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
- 2024MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoning
- 2026Agent-Orchestrated Adaptive RAG: A Comparative Study on Structured and Multi-Hop Retrieval
- 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges
- 2025Knowledge-Aware Iterative Retrieval for Multi-Agent Systems
- 2026When Iterative RAG Beats Ideal Evidence: A Diagnostic Study in Scientific Multi-hop Question Answering
- 2026From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG