mlsanityData to 14 Oct 2026

Unlocking LLM Creativity in Science through Analogical Reasoning

arXiv 2605.11258 ↗First posted 11 May 2026cs.AI cs.CL q-bio.QMcited by 6

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Autonomous science promises to augment scientific discovery, particularly in complex fields like biomedicine. However, this requires AI systems that can consistently generate novel and diverse solutions to open-ended problems. We evaluate LLMs on the task of open-ended solution generation and quantify their tendency to mode collapse into low-diversity generations. To mitigate this mode collapse, we introduce analogical reasoning (AR) as a new approach to solution generation. AR generates analogies to cross-domain problems based on shared relational structure, then uses those analogies to search for novel solutions. Compared to baselines, AR discovers significantly more diverse generations (improving solution diversity metrics by 90-173%), generates novel solutions over 50% of the time (compared to as little as 1.6% for baselines), and produces high-quality analogies. To validate the real-world feasibility of AR, we implement AR-generated solutions across four biomedical problems, yielding consistent quantitative gains. AR-generated approaches achieve a nearly 13-fold improvement on distributional metrics for perturbation effect prediction, outperform all baselines on AUPRC when predicting cell-cell communication, infer brain region interactions with a high Spearman correlation (ρ=0.729) to published methods, and establish state-of-the-art performance on 2 datasets for oligonucleotide property prediction. The novel and diverse solutions produced by AR can be used to augment the search space of existing solution generation methods.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 54 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

37 of 54 references.

References · 37

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  2. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  3. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  4. 2025Accelerating scientific discovery with Co-Scientistcited by 401
  5. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  6. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
  7. 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
  8. 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
  9. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  10. 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
  11. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
  12. 2023The Semantic Scholar Open Data Platformcited by 118
25 more
  1. 2023Large Language Models as Analogical Reasonerscited by 107
  2. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
  3. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  4. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
  5. 2024Can large language models explore in-context?cited by 76
  6. 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 68
  7. 2024Strong Model Collapsecited by 65
  8. 2025Diverse Preference Optimizationcited by 52
  9. 2025Base Models Beat Aligned Models at Randomness and Creativitycited by 51
  10. 2024Forcing Diffuse Distributions out of Language Modelscited by 48
  11. 2025The Price of Format: Diversity Collapse in LLMscited by 43
  12. 2023Quality-Diversity through AI Feedbackcited by 40
  13. 2024PerturBench: Benchmarking Machine Learning Models for Cellular Perturbation Analysiscited by 35
  14. 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
  15. 2026Towards Execution-Grounded Automated AI Researchcited by 28
  16. 2025The Denario project: Deep knowledge AI agents for scientific discoverycited by 21
  17. 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 19
  18. 2024Relevant or Random: Can LLMs Truly Perform Analogical Reasoning?cited by 8
  19. 2025Reliable Proof Generation with LLMs via Analogical Retrieval and Symbolic Verification: A Case Study in Euclidean Geometrycited by 7
  20. 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMscited by 7
  21. 2025HypoSpace: A Diagnostic Benchmark for Set-Valued Hypothesis Generation under Underdetermination and Sublinear Coverage Boundscited by 6
  22. 2024Shared Imagination: LLMs Hallucinate Alikecited by 5
  23. 2025DIVE: Diversified Iterative Self-Improvementcited by 3
  24. 2025Can LLMs Help Improve Analogical Reasoning For Strategic Decisions? Experimental Evidence from Humans and GPT-4cited by 2
  25. 2025U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibilitycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cognitive Loop via In-Situ Optimization: Self-Adaptive Reasoning for Science
  2. 2026LLM-to-Flow Distillation: Teaching Natural Language Goals to Scientific Generators
  3. 2026FALSIFYBENCH: Evaluating Inductive Reasoning in LLMs with Rule Discovery Games
  4. 2025AI-Researcher: Autonomous Scientific Innovation
  5. 2026Contemporary AI lacks the imagination to diverge or negate in science
  6. 2025Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
  7. 2026The Little Scientist: LLM Agent-Driven Discovery via the Scientific Method
  8. 2025Unlearning as Ablation: Toward a Falsifiable Benchmark for Generative Scientific Discovery