IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery
Not on the map. Why?
Abstract (arXiv)
The rapid advancement in capabilities of large language models (LLMs) raises a pivotal question: How can LLMs accelerate scientific discovery? This work tackles the crucial first stage of research, generating novel hypotheses. While recent work on automated hypothesis generation focuses on multi-agent frameworks and extending test-time compute, none of the approaches effectively incorporate transparency and steerability through a synergistic Human-in-the-loop (HITL) approach. To address this gap, we introduce IRIS: Interactive Research Ideation System, an open-source platform designed for researchers to leverage LLM-assisted scientific ideation. IRIS incorporates innovative features to enhance ideation, including adaptive test-time compute expansion via Monte Carlo Tree Search (MCTS), fine-grained feedback mechanism, and query-based literature synthesis. Designed to empower researchers with greater control and insight throughout the ideation process. We additionally conduct a user study with researchers across diverse disciplines, validating the effectiveness of our system in enhancing ideation. We open-source our code at https://github.com/Anikethh/IRIS-Interactive-Research-Ideation-System
Key facts. Cited by 18 papers in the map (data through 13 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
33 of 58 references.
References · 33
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,433
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,041
- 2020Fact or Fiction: Verifying Scientific Claimscited by 552
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 413
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 363
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 357
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 353
- 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 309
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 177
- 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 165
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 145
- 2024Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solverscited by 138
21 more
- 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 131
- 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agentscited by 96
- 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMscited by 67
- 2022NLPeer: A Unified Resource for the Computational Study of Peer Reviewcited by 60
- 2024Design Principles for Generative AI Applicationscited by 57
- 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 56
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 54
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 46
- 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 41
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 41
- 2021DISAPERE: A Dataset for Discourse Structure in Peer Review Discussionscited by 35
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
- 2023Understanding Users' Dissatisfaction with ChatGPT Responses: Types, Resolving Tactics, and the Effect of Knowledge Levelcited by 26
- 2014Bandit Algorithms for Tree Searchcited by 25
- 2024Can Large Language Models Unlock Novel Scientific Research Ideas?cited by 24
- 2025Ai2 Scholar QA: Organized Literature Synthesis with Attributioncited by 24
- 2021Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Studycited by 23
- 2024OpenResearcher: Unleashing AI for Accelerated Scientific Researchcited by 23
- 2018Over-Optimization of Academic Publishing Metrics: Observing Goodhart's Law in Actioncited by 22
- 2020AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approachcited by 21
- 2022The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failurescited by 3
Built on by
Citing papers per year: 2025: 6; 2026: 12.
18 papers.
Sort:
By area:
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 48
- 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 21
- 2025CellForge: Agentic Design of Virtual Cell Modelscited by 12
- 2025ScholarEval: Research Idea Evaluation Grounded in Literaturecited by 12
- 2026Measuring the Gap Between Human and LLM Research Ideascited by 9
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 7
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Executioncited by 5
- 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideationcited by 4
- 2026PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Reviewcited by 3
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 2
- 2026ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomescited by 2
- 2026SciDER: Scientific Data-centric End-to-end Researchercited by 1
6 more
- 2026Dr. Claw: An AI Scientist Workspace for Vibe Researchcited by 1
- 2025Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaborationcited by 0
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structurecited by 0
- 2026Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearningcited by 0
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Modelscited by 0
- 2026Learning to Ideate for Scientific Impactcited by 0
- 2026Learning to Ideate for Scientific Impact24 Sep 2026
- 2026Dr. Claw: An AI Scientist Workspace for Vibe Research31 Aug 2026
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models31 Aug 2026
- 2026Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearning21 Aug 2026
- 2026ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes5 Jul 2026
- 2026Measuring the Gap Between Human and LLM Research Ideas1 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structure17 Jun 2026
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Execution20 Apr 2026
- 2026SciDER: Scientific Data-centric End-to-end Researcher2 Mar 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2026PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Review7 Jan 2026
6 more
- 2025ScholarEval: Research Idea Evaluation Grounded in Literature17 Oct 2025
- 2025Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaboration8 Oct 2025
- 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideation24 Sep 2025
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomatics18 Sep 2025
- 2025CellForge: Agentic Design of Virtual Cell Models4 Aug 2025
- 2025AI Scientists Fail Without Strong Implementation Capability2 Jun 2025
- 2025CellForge: Agentic Design of Virtual Cell Modelscited by 12
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 7
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Executioncited by 5
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 2
- 2026Dr. Claw: An AI Scientist Workspace for Vibe Researchcited by 1
- 2026Dr. Claw: An AI Scientist Workspace for Vibe Research31 Aug 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Execution20 Apr 2026
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomatics18 Sep 2025
- 2025CellForge: Agentic Design of Virtual Cell Models4 Aug 2025
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 48
- 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideationcited by 4
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Modelscited by 0
- 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models31 Aug 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideation24 Sep 2025
- 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 21
- 2025ScholarEval: Research Idea Evaluation Grounded in Literaturecited by 12
- 2026Measuring the Gap Between Human and LLM Research Ideascited by 9
- 2026PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Reviewcited by 3
- 2026ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomescited by 2
- 2026SciDER: Scientific Data-centric End-to-end Researchercited by 1
- 2025Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaborationcited by 0
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structurecited by 0
- 2026Learning to Ideate for Scientific Impactcited by 0
- 2026Learning to Ideate for Scientific Impact24 Sep 2026
- 2026ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes5 Jul 2026
- 2026Measuring the Gap Between Human and LLM Research Ideas1 Jul 2026
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structure17 Jun 2026
- 2026SciDER: Scientific Data-centric End-to-end Researcher2 Mar 2026
- 2026PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Review7 Jan 2026
- 2025ScholarEval: Research Idea Evaluation Grounded in Literature17 Oct 2025
- 2025Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaboration8 Oct 2025
- 2025AI Scientists Fail Without Strong Implementation Capability2 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2023Large Language Models are Zero Shot Hypothesis Proposers
- 2025Idea2Plan: Exploring AI-Powered Research Planning
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
- 2025Scientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directions
- 2025Large Language Models for Scientific Idea Generation: A Creativity-Centered Survey
- 2025HARPA: A Testability-Driven, Literature-Grounded Framework for Research Ideation
- 2026DeepInnovator: Triggering the Innovative Capabilities of LLMs
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics