mlsanityData to 13 Oct 2026

IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery

arXiv 2504.16728 ↗First posted 23 Apr 2025cs.AI cs.CL cs.HCcited by 18

Not on the map. Why?

Abstract (arXiv)

The rapid advancement in capabilities of large language models (LLMs) raises a pivotal question: How can LLMs accelerate scientific discovery? This work tackles the crucial first stage of research, generating novel hypotheses. While recent work on automated hypothesis generation focuses on multi-agent frameworks and extending test-time compute, none of the approaches effectively incorporate transparency and steerability through a synergistic Human-in-the-loop (HITL) approach. To address this gap, we introduce IRIS: Interactive Research Ideation System, an open-source platform designed for researchers to leverage LLM-assisted scientific ideation. IRIS incorporates innovative features to enhance ideation, including adaptive test-time compute expansion via Monte Carlo Tree Search (MCTS), fine-grained feedback mechanism, and query-based literature synthesis. Designed to empower researchers with greater control and insight throughout the ideation process. We additionally conduct a user study with researchers across diverse disciplines, validating the effectiveness of our system in enhancing ideation. We open-source our code at https://github.com/Anikethh/IRIS-Interactive-Research-Ideation-System

Key facts. Cited by 18 papers in the map (data through 13 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

33 of 58 references.

References · 33

  1. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,433
  2. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,041
  3. 2020Fact or Fiction: Verifying Scientific Claimscited by 552
  4. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 413
  5. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 363
  6. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 357
  7. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 353
  8. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 309
  9. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 177
  10. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 165
  11. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 145
  12. 2024Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solverscited by 138
21 more
  1. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 131
  2. 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agentscited by 96
  3. 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMscited by 67
  4. 2022NLPeer: A Unified Resource for the Computational Study of Peer Reviewcited by 60
  5. 2024Design Principles for Generative AI Applicationscited by 57
  6. 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 56
  7. 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 54
  8. 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 46
  9. 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 41
  10. 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 41
  11. 2021DISAPERE: A Dataset for Discourse Structure in Peer Review Discussionscited by 35
  12. 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
  13. 2023Understanding Users' Dissatisfaction with ChatGPT Responses: Types, Resolving Tactics, and the Effect of Knowledge Levelcited by 26
  14. 2014Bandit Algorithms for Tree Searchcited by 25
  15. 2024Can Large Language Models Unlock Novel Scientific Research Ideas?cited by 24
  16. 2025Ai2 Scholar QA: Organized Literature Synthesis with Attributioncited by 24
  17. 2021Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Studycited by 23
  18. 2024OpenResearcher: Unleashing AI for Accelerated Scientific Researchcited by 23
  19. 2018Over-Optimization of Academic Publishing Metrics: Observing Goodhart's Law in Actioncited by 22
  20. 2020AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approachcited by 21
  21. 2022The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failurescited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 6; 2026: 12.

18 papers.

Sort:

By area:

  1. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 48
  2. 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 21
  3. 2025CellForge: Agentic Design of Virtual Cell Modelscited by 12
  4. 2025ScholarEval: Research Idea Evaluation Grounded in Literaturecited by 12
  5. 2026Measuring the Gap Between Human and LLM Research Ideascited by 9
  6. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 7
  7. 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Executioncited by 5
  8. 2025Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideationcited by 4
  9. 2026PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Reviewcited by 3
  10. 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 2
  11. 2026ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomescited by 2
  12. 2026SciDER: Scientific Data-centric End-to-end Researchercited by 1
6 more
  1. 2026Dr. Claw: An AI Scientist Workspace for Vibe Researchcited by 1
  2. 2025Evolving and Executing Research Plans via Double-Loop Multi-Agent Collaborationcited by 0
  3. 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structurecited by 0
  4. 2026Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearningcited by 0
  5. 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Modelscited by 0
  6. 2026Learning to Ideate for Scientific Impactcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Large Language Models are Zero Shot Hypothesis Proposers
  2. 2025Idea2Plan: Exploring AI-Powered Research Planning
  3. 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
  4. 2025Scientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directions
  5. 2025Large Language Models for Scientific Idea Generation: A Creativity-Centered Survey
  6. 2025HARPA: A Testability-Driven, Literature-Grounded Framework for Research Ideation
  7. 2026DeepInnovator: Triggering the Innovative Capabilities of LLMs
  8. 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics