mlsanityData to 14 Oct 2026

An Interdisciplinary Outlook on Large Language Models for Scientific Research

arXiv 2311.04929 ↗First posted 3 Nov 2023cs.CL cs.AI cs.DLcited by 15

Not on the map. Why?

Abstract (arXiv)

In this paper, we describe the capabilities and constraints of Large Language Models (LLMs) within disparate academic disciplines, aiming to delineate their strengths and limitations with precision. We examine how LLMs augment scientific inquiry, offering concrete examples such as accelerating literature review by summarizing vast numbers of publications, enhancing code development through automated syntax correction, and refining the scientific writing process. Simultaneously, we articulate the challenges LLMs face, including their reliance on extensive and sometimes biased datasets, and the potential ethical dilemmas stemming from their use. Our critical discussion extends to the varying impacts of LLMs across fields, from the natural sciences, where they help model complex biological sequences, to the social sciences, where they can parse large-scale qualitative data. We conclude by offering a nuanced perspective on how LLMs can be both a boon and a boundary to scientific progress.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 50 of its 125 references that are in the map. First posted on arXiv 3 Nov 2023.

Builds on

50 of 125 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2023Let's Verify Step by Stepcited by 3,789
  6. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  7. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  8. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  9. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  10. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  11. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  12. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 600
38 more
  1. 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
  2. 2022Using cognitive psychology to understand GPT-3cited by 398
  3. 2022A Systematic Evaluation of Large Language Models of Codecited by 363
  4. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
  5. 2023Mathematical Capabilities of ChatGPTcited by 268
  6. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
  7. 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
  8. 2020Unsupervised Translation of Programming Languagescited by 263
  9. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  10. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
  11. 2019SPoC: Search-based Pseudocode to Codecited by 176
  12. 2022Language models show human-like content effects on reasoning taskscited by 173
  13. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
  14. 2021Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Modelscited by 141
  15. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 127
  16. 2022Explanations from Large Language Models Make Small Reasoners Bettercited by 124
  17. 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
  18. 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 86
  19. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
  20. 2023InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrievalcited by 73
  21. 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
  22. 2023Explaining black box text modules in natural language with language modelscited by 62
  23. 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
  24. 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
  25. 2023Understanding Causality with Large Language Models: Feasibility and Opportunitiescited by 53
  26. 2023ChatGPT Chemistry Assistant for Text Mining and Prediction of MOF Synthesiscited by 51
  27. 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
  28. 2023ChatGPT for Programming Numerical Methodscited by 26
  29. 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
  30. 2021Building astroBERT, a language model for Astronomy & Astrophysicscited by 19
  31. 2023Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practicecited by 15
  32. 2023Leveraging Large Language Models for Topic Classification in the Domain of Public Affairscited by 13
  33. 2019Dynamic Stale Synchronous Parallel Distributed Training for Deep Learningcited by 12
  34. 2022SsciBERT: A Pre-trained Language Model for Social Science Textscited by 12
  35. 2023Mathematics, word problems, common sense, and artificial intelligencecited by 12
  36. 2020Public Sentiment Toward Solar Energy: Opinion Mining of Twitter Using a Transformer-Based Language Modelcited by 6
  37. 2022Visualizing and Explaining Language Modelscited by 4
  38. 2020Dataset Search In Biodiversity Research: Do Metadata In Data Repositories Reflect Scholarly Information Needs?cited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 8; 2025: 3; 2026: 2.

15 papers.

Sort:

By area:

  1. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
  2. 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
  3. 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 48
  4. 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applicationscited by 37
  5. 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligencecited by 36
  6. 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Taskscited by 18
  7. 2023Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challengescited by 13
  8. 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Modelscited by 9
  9. 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
  10. 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Sciencecited by 5
  11. 2024Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answerscited by 1
  12. 2024Scientific QA System with Verifiable Answerscited by 1
3 more
  1. 2025League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Modelscited by 0
  2. 2026A Cloud-based Multi-Agentic Workflow for Sciencecited by 0
  3. 2026Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?cited by 0