A framework for auditing grounding claims
Not on the map. Why?
Abstract (arXiv)
The symbol grounding problem asks how a token such as cat can be about cats. We propose a framework for auditing grounding claims against a declared semantic standard. The audit reports measurements and evidence, with overall verdicts conditional on explicit acceptance criteria. Its profiles assess accuracy, robustness, and composition alongside evidence about how the system acquired its mechanisms, how they contribute to performance, and why they were retained. In a toy gridworld, an agent interprets individual symbols accurately but fails a withheld combination. Composing its interpretations by the declared rule would succeed. This comparison identifies a departure from the composition rule within the observed failure. Both this audit and a pilot on pretrained word vectors provide evidence that a designated mechanism contributes to present performance. Whether that contribution explains its retention remains uncertified. The framework evaluates the evidence for grounding claims; candidate accounts remain responsible for explaining how meaning emerges.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 87 references that are in the map. First posted on arXiv 5 Dec 2025.
Builds on
25 of 87 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
- 2021Causal Abstractions of Neural Networkscited by 401
- 2020COGS: A Compositional Generalization Challenge Based on Semantic Interpretationcited by 260
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
13 more
- 2021Implicit Representations of Meaning in Neural Language Modelscited by 179
- 2014SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimationcited by 170
- 2023Getting aligned on representational alignmentcited by 142
- 2021Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Colorcited by 118
- 2021Evaluating the Robustness of Neural Language Models to Input Perturbationscited by 87
- 2023The Vector Grounding Problemcited by 39
- 2025Understanding the Emergence of Multimodal Representation Alignmentcited by 28
- 2021How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropycited by 23
- 2024Resilience of Large Language Models for Noisy Instructionscited by 20
- 2023Do Language Models' Words Refer?cited by 17
- 2024Robustness of Large Language Models to Perturbations in Textcited by 11
- 2025Entailment-Preserving First-order Logic Representations in Natural Language Entailmentcited by 4
- 2023On the Robustness of Text Vectorizerscited by 2
Built on by
Not cited yet.