Evolving Idea Graphs with Learnable Edits-and-Commits for Multi-Agent Scientific Ideation
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
LLM-empowered multi-agent systems offer new potential to accelerate scientific discovery by generating novel research ideas. However, existing methods typically coordinate agents through temporary texts, such as drafts or chat logs; it is difficult to pinpoint the weaknesses in the generated ideas and how the agents refine them. To this end, we introduce Evolving Idea Graphs (EIG), a graph-based multi-agent scientific ideation framework that can generate high-performance research ideas across various benchmark-native metrics, such as novelty, feasibility, and clarity. Instead of coordinating solely through texts, EIG represents a partially formed proposal as an evolving idea graph, where nodes capture scientific claims and edges encode relations (e.g., support and conflict), enabling unresolved weaknesses to remain identifiable throughout the idea evolving process. Specifically, a learned two-head controller operates over the evolving graph to guide the ideation: one head selects graph edits for agents to execute, while the other decides when the graph is ready for commit as final proposal synthesis. On AI Idea Bench 2025 and LiveIdeaBench, EIG outperforms all compared systems on both automatic benchmark scores and blinded expert ratings. Ablations show that the graph-based state, its typed relations, and the learned edit-and-commit control each contribute to final proposal quality.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 44 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
36 of 44 references.
Closest ancestors · 5
Same direction, newest first
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug
- 2025Exploring Design of Multi-Agent LLM Dialogues for Research Ideation11 Jul
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System12 Oct
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Models1 Jul
Other references · 31
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
19 more
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
- 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
- 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 78
- 2024Agent Planning with World Knowledge Modelcited by 70
- 2025AI Idea Bench 2025: AI Research Idea Generation Benchmarkcited by 40
- 2019PaperRobot: Incremental Draft Generation of Scientific Ideascited by 37
- 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 28
- 2024SciPIP: An LLM-based Scientific Paper Idea Proposercited by 26
- 2025Git Context Controller: Manage the Context of LLM-based Agents like Gitcited by 15
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systemscited by 12
- 2025S-DAG: A Subject-Based Directed Acyclic Graph for Multi-Agent Heterogeneous Reasoningcited by 9
- 2023Exploring and Verbalizing Academic Ideas by Concept Co-occurrencecited by 8
- 2025Towards AI as Colleagues: Multi-Agent System Improves Structured Ideation Processescited by 6
- 2025HybridFlow: Resource-Adaptive Subtask Routing for Efficient Edge-Cloud LLM Inferencecited by 6
- 2025MotivGraph-SoIQ: Integrating Motivational Knowledge Graphs and Socratic Dialogue for Enhanced LLM Ideationcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EvoSci: A Bio-Inspired Multi-Agent Framework for the Evolution of Scientific Discovery
- 2026Agents-K1: Towards Agent-native Knowledge Orchestration
- 2026Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents
- 2026IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
- 2026AgentIdeaBench: Benchmarking Scientific Ideation in the Agent Era
- 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery
- 2025InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research
- 2026Enhancing Research Idea Generation through Combinatorial Innovation and Multi-Agent Iterative Search Strategies