Do Large Language Models Advocate for Inferentialism?
Not on the map. Why?
Abstract (arXiv)
The emergence of large language models (LLMs) such as ChatGPT and Claude presents new challenges for philosophy of language, particularly regarding the nature of linguistic meaning and representation. While LLMs have traditionally been understood through distributional semantics, this paper explores Robert Brandom's inferential semantics as an alternative foundational framework for understanding these systems. We examine how key features of inferential semantics -- including its anti-representationalist stance, logical expressivism, and quasi-compositional approach -- align with the architectural and functional characteristics of Transformer-based LLMs. Through analysis of the ISA (Inference, Substitution, Anaphora) approach, we demonstrate that LLMs exhibit fundamentally anti-representationalist properties in their processing of language. We further develop a consensus theory of truth appropriate for LLMs, grounded in their interactive and normative dimensions through mechanisms like RLHF. While acknowledging significant tensions between inferentialism's philosophical commitments and LLMs' sub-symbolic processing, this paper argues that inferential semantics provides valuable insights into how LLMs generate meaning without reference to external world representations. Our analysis suggests that LLMs may challenge traditional assumptions in philosophy of language, including strict compositionality and semantic externalism, though further empirical investigation is needed to fully substantiate these theoretical claims.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 93 references that are in the map. First posted on arXiv 19 Dec 2024.
Builds on
30 of 93 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2022In-context Learning and Induction Headscited by 930
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
18 more
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2023A Survey of Reinforcement Learning from Human Feedbackcited by 259
- 2022Talking About Large Language Modelscited by 174
- 2019Neural Machine Translation with Byte-Level Subwordscited by 115
- 2024Small Language Models: Survey, Measurements, and Insightscited by 109
- 2019Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasetscited by 41
- 2021The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Failcited by 38
- 2024A Survey of Small Language Modelscited by 31
- 2024Language Models as Models of Languagecited by 24
- 2024A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debatescited by 22
- 2024Are Language Models More Like Libraries or Like Librarians? Bibliotechnism, the Novel Reference Problem, and the Attitudes of LLMscited by 11
- 2024Large language models and linguistic intentionalitycited by 6
- 2023Meaning and understanding in large language modelscited by 5
- 2021Revisiting Additive Compositionality: AND, OR and NOT Operations with Word Embeddingscited by 4
- 2024Making AI Intelligible: Philosophical Foundationscited by 4
- 2024Are LLMs Models of Distributional Semantics? A Case Study on Quantifierscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025MolGround: A Benchmark for Molecular Groundingcited by 1
- 2025MolGround: A Benchmark for Molecular Grounding31 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2023Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners
- 2024Conditional and Modal Reasoning in Large Language Models
- 2023Simple Linguistic Inferences of Large Language Models (LLMs): Blind Spots and Blinds
- 2025Language and Thought: The View from LLMs
- 2026On Epistemic Diversity in Large Language Models
- 2026LLM Reasoning Is Latent, Not the Chain of Thought
- 2024Can Large Language Models Act as Symbolic Reasoners?
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement