mlsanityData to 14 Oct 2026

Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaboration

arXiv 2510.06761 ↗First posted 8 Oct 2025cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Automating the end-to-end scientific research process poses a fundamental challenge: it requires both evolving high-level plans that are novel and sound, and executing these plans correctly amidst dynamic and uncertain conditions. To address this bilevel challenge, we propose a novel Double-Loop Multi-Agent (DLMA) framework to solve the given research problem automatically. The leader loop, composed of professor agents, is responsible for evolving research plans. It employs an evolutionary algorithm through involvement, improvement, and integration meetings to iteratively generate and refine a pool of research proposals, exploring the solution space effectively. The follower loop, composed of doctoral student agents, is responsible for executing the best-evolved plan. It dynamically adjusts the plan during implementation via pre-hoc and post-hoc meetings, ensuring each step (e.g., drafting, coding) is well-supported by contextual and external observations. Extensive experiments on benchmarks like ACLAward and Laboratory show that DLMA generates research papers that achieve state-of-the-art scores in automated evaluation, significantly outperforming strong baselines. Ablation studies confirm the critical roles of both loops, with evolution driving novelty and execution ensuring soundness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

16 of 25 references.

References · 16

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  2. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  3. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  4. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  5. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  6. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
  7. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  8. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  9. 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
  10. 2025Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedbackcited by 25
  11. 2024Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Interventioncited by 24
  12. 2022A Computational Inflection for Scientific Discoverycited by 23
4 more
  1. 2025IRIS: Interactive Research Ideation System for Accelerating Scientific Discoverycited by 19
  2. 2025All That Glitters is Not Novel: Plagiarism in AI Generated Researchcited by 18
  3. 2025ResearchCodeAgent: An LLM Multi-Agent System for Automated Codification of Research Methodologiescited by 15
  4. 2025LaTIM: Measuring Latent Token-to-Token Interactions in Mamba Modelscited by 6

Built on by

Not cited yet.