mlsanityData to 7 Oct 2026

How should the advent of large language models affect the practice of science?

arXiv 2312.03759 ↗First posted 5 Dec 2023cs.CL cs.AI cs.CYcited by 8

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are being increasingly incorporated into scientific workflows. However, we have yet to fully grasp the implications of this integration. How should the advent of large language models affect the practice of science? For this opinion piece, we have invited four diverse groups of scientists to reflect on this query, sharing their perspectives and engaging in debate. Schulz et al. make the argument that working with LLMs is not fundamentally different from working with human collaborators, while Bender et al. argue that LLMs are often misused and over-hyped, and that their limitations warrant a focus on more specialized, easily interpretable tools. Marelli et al. emphasize the importance of transparent attribution and responsible use of LLMs. Finally, Botvinick and Gershman advocate that humans should retain responsibility for determining the scientific roadmap. To facilitate the discussion, the four perspectives are complemented with a response from each group. By putting these different perspectives in conversation, we aim to bring attention to important considerations within the academic community regarding the adoption of LLMs and their impact on both current and future scientific practices.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 64 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

31 of 64 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Learning to summarize from human feedbackcited by 2,562
  3. 2020Extracting Training Data from Large Language Modelscited by 2,144
  4. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  5. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  6. 2023StarCoder: may the source be with you!cited by 790
  7. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  8. 2022Galactica: A Large Language Model for Sciencecited by 736
  9. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  10. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  11. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
  12. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
19 more
  1. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
  2. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  3. 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
  4. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  5. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  6. 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 175
  7. 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
  8. 2018Ranking Sentences for Extractive Summarization with Reinforcement Learningcited by 128
  9. 2023The Semantic Scholar Open Data Platformcited by 109
  10. 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
  11. 2022Rediscovering orbital mechanics with machine learningcited by 71
  12. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
  13. 2023ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishingcited by 51
  14. 2023AI-assisted coding: Experiments with GPT-4cited by 43
  15. 2023GPT-4 Can't Reasoncited by 39
  16. 2021The Challenge of Value Alignment: from Fairer Algorithms to AI Safetycited by 34
  17. 2023Friend or Foe? Exploring the Implications of Large Language Models on the Science Systemcited by 15
  18. 2023Response: Emergent analogical reasoning in large language modelscited by 13
  19. 2023AI, write an essay for me: A large-scale comparison of human-written versus ChatGPT-generated essayscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 1.

8 papers.