mlsanityData to 14 Oct 2026

MIR: Methodology Inspiration Retrieval for Scientific Research Problems

arXiv 2506.00249 ↗First posted 30 May 2025cs.AI cs.CLcited by 11

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

There has been a surge of interest in harnessing the reasoning capabilities of Large Language Models (LLMs) to accelerate scientific discovery. While existing approaches rely on grounding the discovery process within the relevant literature, effectiveness varies significantly with the quality and nature of the retrieved literature. We address the challenge of retrieving prior work whose concepts can inspire solutions for a given research problem, a task we define as Methodology Inspiration Retrieval (MIR). We construct a novel dataset tailored for training and evaluating retrievers on MIR, and establish baselines. To address MIR, we build the Methodology Adjacency Graph (MAG); capturing methodological lineage through citation relationships. We leverage MAG to embed an "intuitive prior" into dense retrievers for identifying patterns of methodological inspiration beyond superficial semantic similarity. This achieves significant gains of +5.4 in Recall@3 and +7.8 in Mean Average Precision (mAP) over strong baselines. Further, we adapt LLM-based re-ranking strategies to MIR, yielding additional improvements of +4.5 in Recall@3 and +4.8 in mAP. Through extensive ablation studies and qualitative analyses, we exhibit the promise of MIR in enhancing automated scientific discovery and outline avenues for advancing inspiration-driven retrieval.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 47 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

33 of 47 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking31 Oct
  2. 2024RAR-b: Reasoning as Retrieval Benchmark9 Apr
  3. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec

Other references · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  6. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  7. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  8. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  9. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  10. 2024Generative Representational Instruction Tuningcited by 233
  11. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  12. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
18 more
  1. 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
  2. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  3. 2023The Semantic Scholar Open Data Platformcited by 118
  4. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  5. 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agentscited by 97
  6. 2024Making Text Embedders Few-Shot Learnerscited by 79
  7. 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
  8. 2024FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructionscited by 69
  9. 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agentscited by 67
  10. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
  11. 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
  12. 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
  13. 2024Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Modelscited by 40
  14. 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
  15. 2021MultiCite: Modeling realistic citations requires moving beyond the single-sentence single-label settingcited by 30
  16. 2024Can Large Language Models Unlock Novel Scientific Research Ideas?cited by 24
  17. 2022Specialized Document Embeddings for Aspect-based Similarity of Research Paperscited by 12
  18. 2023Paragraph-level Citation Recommendation based on Topic Sentences as Queriescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 9.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Graph Your Way to Inspiration: Integrating Co-Author Graphs with Retrieval-Augmented Generation for Large Language Model Based Scientific Idea Generation
  2. 2025ScholarEval: Research Idea Evaluation Grounded in Literature
  3. 2025Literature-Grounded Novelty Assessment of Scientific Ideas
  4. 2026Graph2Idea:Retrieval-Augmented Scientific Idea Generation with Graph-Structured Contexts
  5. 2026Intern-Atlas: A Methodological Evolution Graph as Research Infrastructure for AI Scientists
  6. 2026Large Knowledge Model: From Papers to a Scientific Reasoning Landscape
  7. 2026Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models
  8. 2024ResearchArena: Benchmarking Large Language Models' Ability to Collect and Organize Information as Research Agents