Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery
Not on the map. Why?
Abstract (arXiv)
With recent Nobel Prizes recognising AI contributions to science, Large Language Models (LLMs) are transforming scientific research by enhancing productivity and reshaping the scientific method. LLMs are now involved in experimental design, data analysis, and workflows, particularly in chemistry and biology. However, challenges such as hallucinations and reliability persist. In this contribution, we review how Large Language Models (LLMs) are redefining the scientific method and explore their potential applications across different stages of the scientific cycle, from hypothesis testing to discovery. We conclude that, for LLMs to serve as relevant and effective creative engines and productivity enhancers, their deep integration into all steps of the scientific process should be pursued in collaboration and alignment with human scientific goals, with clear evaluation metrics. The transition to AI-driven science raises ethical questions about creativity, oversight, and responsibility. With careful guidance, LLMs could evolve into creative engines, driving transformative breakthroughs across scientific disciplines responsibly and effectively. However, the scientific community must also decide how much it leaves to LLMs to drive science, even when associations with 'reasoning', mostly currently undeserved, are made in exchange for the potential to explore hypothesis and solution regions that might otherwise remain unexplored by human exploration alone.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 119 of its 196 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
119 of 196 references.
References · 119
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
38 more
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2019Attention is not Explanationcited by 916
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2023Large Language Models as Optimizerscited by 830
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2019Attention is not not Explanationcited by 629
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
50 most cited of 119 All 119 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedbackcited by 24
- 2026Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMscited by 4
- 2026LLM-Generated or Human-Written? Comparing Review and Non-Review Papers on ArXivcited by 3
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?cited by 2
- 2026Quantifying Faithful Confidence Expression in Large Reasoning Modelscited by 2
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2025Does Less Hallucination Mean Less Creativity? An Empirical Investigation in LLMscited by 0
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMs30 Jun 2026
- 2026Quantifying Faithful Confidence Expression in Large Reasoning Models2 Jun 2026
- 2026Can LLMs Use Linguistic Uncertainty Markers to Reliably Reflect Intrinsic Confidence?27 May 2026
- 2026LLM-Generated or Human-Written? Comparing Review and Non-Review Papers on ArXiv19 Jan 2026
- 2025Does Less Hallucination Mean Less Creativity? An Empirical Investigation in LLMs12 Dec 2025
- 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback7 Oct 2025