mlsanityData to 7 Oct 2026

Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery

arXiv 2505.16477 ↗First posted 22 May 2025cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

With recent Nobel Prizes recognising AI contributions to science, Large Language Models (LLMs) are transforming scientific research by enhancing productivity and reshaping the scientific method. LLMs are now involved in experimental design, data analysis, and workflows, particularly in chemistry and biology. However, challenges such as hallucinations and reliability persist. In this contribution, we review how Large Language Models (LLMs) are redefining the scientific method and explore their potential applications across different stages of the scientific cycle, from hypothesis testing to discovery. We conclude that, for LLMs to serve as relevant and effective creative engines and productivity enhancers, their deep integration into all steps of the scientific process should be pursued in collaboration and alignment with human scientific goals, with clear evaluation metrics. The transition to AI-driven science raises ethical questions about creativity, oversight, and responsibility. With careful guidance, LLMs could evolve into creative engines, driving transformative breakthroughs across scientific disciplines responsibly and effectively. However, the scientific community must also decide how much it leaves to LLMs to drive science, even when associations with 'reasoning', mostly currently undeserved, are made in exchange for the potential to explore hypothesis and solution regions that might otherwise remain unexplored by human exploration alone.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 119 of its 196 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

119 of 196 references.

References · 119

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  11. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  12. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
38 more
  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  4. 2022Emergent Abilities of Large Language Modelscited by 2,483
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  10. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  11. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  12. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  13. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  14. 2019Attention is not Explanationcited by 916
  15. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  16. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  17. 2023Large Language Models as Optimizerscited by 830
  18. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  19. 2024A Survey on Large Language Models for Code Generationcited by 646
  20. 2019Attention is not not Explanationcited by 629
  21. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  22. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  23. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  24. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  25. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
  26. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  27. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
  28. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
  29. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  30. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  31. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
  32. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  33. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  34. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  35. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  36. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  37. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  38. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266

50 most cited of 119 All 119 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.