Unlocking LLM Creativity in Science through Analogical Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Autonomous science promises to augment scientific discovery, particularly in complex fields like biomedicine. However, this requires AI systems that can consistently generate novel and diverse solutions to open-ended problems. We evaluate LLMs on the task of open-ended solution generation and quantify their tendency to mode collapse into low-diversity generations. To mitigate this mode collapse, we introduce analogical reasoning (AR) as a new approach to solution generation. AR generates analogies to cross-domain problems based on shared relational structure, then uses those analogies to search for novel solutions. Compared to baselines, AR discovers significantly more diverse generations (improving solution diversity metrics by 90-173%), generates novel solutions over 50% of the time (compared to as little as 1.6% for baselines), and produces high-quality analogies. To validate the real-world feasibility of AR, we implement AR-generated solutions across four biomedical problems, yielding consistent quantitative gains. AR-generated approaches achieve a nearly 13-fold improvement on distributional metrics for perturbation effect prediction, outperform all baselines on AUPRC when predicting cell-cell communication, infer brain region interactions with a high Spearman correlation (ρ=0.729) to published methods, and establish state-of-the-art performance on 2 datasets for oligonucleotide property prediction. The novel and diverse solutions produced by AR can be used to augment the search space of existing solution generation methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 54 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
37 of 54 references.
References · 37
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
- 2023The Semantic Scholar Open Data Platformcited by 118
25 more
- 2023Large Language Models as Analogical Reasonerscited by 107
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
- 2024Can large language models explore in-context?cited by 76
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 68
- 2024Strong Model Collapsecited by 65
- 2025Diverse Preference Optimizationcited by 52
- 2025Base Models Beat Aligned Models at Randomness and Creativitycited by 51
- 2024Forcing Diffuse Distributions out of Language Modelscited by 48
- 2025The Price of Format: Diversity Collapse in LLMscited by 43
- 2023Quality-Diversity through AI Feedbackcited by 40
- 2024PerturBench: Benchmarking Machine Learning Models for Cellular Perturbation Analysiscited by 35
- 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
- 2026Towards Execution-Grounded Automated AI Researchcited by 28
- 2025The Denario project: Deep knowledge AI agents for scientific discoverycited by 21
- 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 19
- 2024Relevant or Random: Can LLMs Truly Perform Analogical Reasoning?cited by 8
- 2025Reliable Proof Generation with LLMs via Analogical Retrieval and Symbolic Verification: A Case Study in Euclidean Geometrycited by 7
- 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMscited by 7
- 2025HypoSpace: A Diagnostic Benchmark for Set-Valued Hypothesis Generation under Underdetermination and Sublinear Coverage Boundscited by 6
- 2024Shared Imagination: LLMs Hallucinate Alikecited by 5
- 2025DIVE: Diversified Iterative Self-Improvementcited by 3
- 2025Can LLMs Help Improve Analogical Reasoning For Strategic Decisions? Experimental Evidence from Humans and GPT-4cited by 2
- 2025U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibilitycited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Playing with Words, Improving with Rewards: Training Language Models for Creative Associationcited by 0
- 2026Discovery by Dreaming: Cross-Domain Recombination in Artificial Memorycited by 0
- 2026On the Diversity of Analogy Making in Large Language Modelscited by 0
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structurecited by 0
- 2026Measuring the Creativity of Frontier LLMs in Automated Researchcited by 0
- 2026Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluationcited by 0
- 2026Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation1 Oct 2026
- 2026Measuring the Creativity of Frontier LLMs in Automated Research12 Sep 2026
- 2026On the Diversity of Analogy Making in Large Language Models4 Aug 2026
- 2026Discovery by Dreaming: Cross-Domain Recombination in Artificial Memory28 Jun 2026
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structure17 Jun 2026
- 2026Playing with Words, Improving with Rewards: Training Language Models for Creative Association27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Cognitive Loop via In-Situ Optimization: Self-Adaptive Reasoning for Science
- 2026LLM-to-Flow Distillation: Teaching Natural Language Goals to Scientific Generators
- 2026FALSIFYBENCH: Evaluating Inductive Reasoning in LLMs with Rule Discovery Games
- 2025AI-Researcher: Autonomous Scientific Innovation
- 2026Contemporary AI lacks the imagination to diverge or negate in science
- 2025Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
- 2026The Little Scientist: LLM Agent-Driven Discovery via the Scientific Method
- 2025Unlearning as Ablation: Toward a Falsifiable Benchmark for Generative Scientific Discovery