How should the advent of large language models affect the practice of science?
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are being increasingly incorporated into scientific workflows. However, we have yet to fully grasp the implications of this integration. How should the advent of large language models affect the practice of science? For this opinion piece, we have invited four diverse groups of scientists to reflect on this query, sharing their perspectives and engaging in debate. Schulz et al. make the argument that working with LLMs is not fundamentally different from working with human collaborators, while Bender et al. argue that LLMs are often misused and over-hyped, and that their limitations warrant a focus on more specialized, easily interpretable tools. Marelli et al. emphasize the importance of transparent attribution and responsible use of LLMs. Finally, Botvinick and Gershman advocate that humans should retain responsibility for determining the scientific roadmap. To facilitate the discussion, the four perspectives are complemented with a response from each group. By putting these different perspectives in conversation, we aim to bring attention to important considerations within the academic community regarding the adoption of LLMs and their impact on both current and future scientific practices.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 64 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
31 of 64 references.
References · 31
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Learning to summarize from human feedbackcited by 2,562
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
- 2023StarCoder: may the source be with you!cited by 790
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
19 more
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
- 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
- 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 175
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
- 2018Ranking Sentences for Extractive Summarization with Reinforcement Learningcited by 128
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
- 2023ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishingcited by 51
- 2023AI-assisted coding: Experiments with GPT-4cited by 43
- 2023GPT-4 Can't Reasoncited by 39
- 2021The Challenge of Value Alignment: from Fairer Algorithms to AI Safetycited by 34
- 2023Friend or Foe? Exploring the Implications of Large Language Models on the Science Systemcited by 15
- 2023Response: Emergent analogical reasoning in large language modelscited by 13
- 2023AI, write an essay for me: A large-scale comparison of human-written versus ChatGPT-generated essayscited by 9
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 1.
8 papers.
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2024CogBench: a large language model walks into a psychology labcited by 60
- 2024In-context learning agents are asymmetric belief updaterscited by 13
- 2025Generating Computational Cognitive Models using Large Language Modelscited by 12
- 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmascited by 12
- 2024A Survey on Human-AI Collaboration with Large Foundation Modelscited by 7
- 2025Information Retrieval in the Age of Generative AI: The RGB Modelcited by 2
- 2026Smaller, Younger, and More Impactful: How AI-Assisted Writing Transforms Research Teamscited by 0
- 2026Smaller, Younger, and More Impactful: How AI-Assisted Writing Transforms Research Teams24 Apr 2026
- 2025Information Retrieval in the Age of Generative AI: The RGB Model29 Apr 2025
- 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmas25 Mar 2025
- 2025Generating Computational Cognitive Models using Large Language Models2 Feb 2025
- 2024A Survey on Human-AI Collaboration with Large Foundation Models7 Mar 2024
- 2024CogBench: a large language model walks into a psychology lab28 Feb 2024
- 2024In-context learning agents are asymmetric belief updaters6 Feb 2024
- 2024Security and Privacy Challenges of Large Language Models: A Survey30 Jan 2024