An Interdisciplinary Outlook on Large Language Models for Scientific Research
Not on the map. Why?
Abstract (arXiv)
In this paper, we describe the capabilities and constraints of Large Language Models (LLMs) within disparate academic disciplines, aiming to delineate their strengths and limitations with precision. We examine how LLMs augment scientific inquiry, offering concrete examples such as accelerating literature review by summarizing vast numbers of publications, enhancing code development through automated syntax correction, and refining the scientific writing process. Simultaneously, we articulate the challenges LLMs face, including their reliance on extensive and sometimes biased datasets, and the potential ethical dilemmas stemming from their use. Our critical discussion extends to the varying impacts of LLMs across fields, from the natural sciences, where they help model complex biological sequences, to the social sciences, where they can parse large-scale qualitative data. We conclude by offering a nuanced perspective on how LLMs can be both a boon and a boundary to scientific progress.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 50 of its 125 references that are in the map. First posted on arXiv 3 Nov 2023.
Builds on
50 of 125 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Let's Verify Step by Stepcited by 3,789
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 600
38 more
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2022A Systematic Evaluation of Large Language Models of Codecited by 363
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
- 2023Mathematical Capabilities of ChatGPTcited by 268
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2022Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Modelcited by 265
- 2020Unsupervised Translation of Programming Languagescited by 263
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2022Language models show human-like content effects on reasoning taskscited by 173
- 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
- 2021Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Modelscited by 141
- 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 127
- 2022Explanations from Large Language Models Make Small Reasoners Bettercited by 124
- 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
- 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 86
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
- 2023InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrievalcited by 73
- 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
- 2023Explaining black box text modules in natural language with language modelscited by 62
- 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
- 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
- 2023Understanding Causality with Large Language Models: Feasibility and Opportunitiescited by 53
- 2023ChatGPT Chemistry Assistant for Text Mining and Prediction of MOF Synthesiscited by 51
- 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
- 2023ChatGPT for Programming Numerical Methodscited by 26
- 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
- 2021Building astroBERT, a language model for Astronomy & Astrophysicscited by 19
- 2023Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practicecited by 15
- 2023Leveraging Large Language Models for Topic Classification in the Domain of Public Affairscited by 13
- 2019Dynamic Stale Synchronous Parallel Distributed Training for Deep Learningcited by 12
- 2022SsciBERT: A Pre-trained Language Model for Social Science Textscited by 12
- 2023Mathematics, word problems, common sense, and artificial intelligencecited by 12
- 2020Public Sentiment Toward Solar Energy: Opinion Mining of Twitter Using a Transformer-Based Language Modelcited by 6
- 2022Visualizing and Explaining Language Modelscited by 4
- 2020Dataset Search In Biodiversity Research: Do Metadata In Data Repositories Reflect Scholarly Information Needs?cited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 8; 2025: 3; 2026: 2.
15 papers.
Sort:
By area:
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 48
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applicationscited by 37
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligencecited by 36
- 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Taskscited by 18
- 2023Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challengescited by 13
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Modelscited by 9
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Sciencecited by 5
- 2024Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answerscited by 1
- 2024Scientific QA System with Verifiable Answerscited by 1
- 2026Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?9 Apr 2026
- 2026A Cloud-based Multi-Agentic Workflow for Science18 Jan 2026
- 2025League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models30 Jul 2025
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models18 May 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applications21 Nov 2024
- 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Tasks2 Oct 2024
- 2024Scientific QA System with Verifiable Answers16 Jul 2024
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence13 Jul 2024
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?10 Jul 2024
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb 2024
- 2024Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answers9 Feb 2024
3 more
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learning27 Jan 2024
- 2023Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges27 Dec 2023
- 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Science5 Dec 2023
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligencecited by 36
- 2026A Cloud-based Multi-Agentic Workflow for Sciencecited by 0
- 2026A Cloud-based Multi-Agentic Workflow for Science18 Jan 2026
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligence13 Jul 2024
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learning27 Jan 2024
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 48
- 2023Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challengescited by 13
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Modelscited by 9
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Sciencecited by 5
- 2024Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answerscited by 1
- 2024Scientific QA System with Verifiable Answerscited by 1
- 2025League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Modelscited by 0
- 2026Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?cited by 0
- 2026Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?9 Apr 2026
- 2025League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models30 Jul 2025
- 2025ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models18 May 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025
- 2024Scientific QA System with Verifiable Answers16 Jul 2024
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?10 Jul 2024
- 2024Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answers9 Feb 2024
- 2023Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges27 Dec 2023
- 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Science5 Dec 2023