Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers?
Not on the map. Why?
Abstract (arXiv)
Formal, Distributional, and Grounded theories of computational semantics each have their uses and their drawbacks. There has been a shift to ground models of language by adding visual knowledge, and there has been a call to enrich models of language with symbolic methods to gain the benefits from formal, distributional, and grounded theories. In this paper, we attempt to make the case that one potential path forward in unifying all three semantic fields is paved with the words-as-classifier model, a model of word-level grounded semantics that has been incorporated into formalisms and distributional language models in the literature, and it has been well-tested within interactive dialogue settings. We review that literature, motivate the words-as-classifiers model with an appeal to recent work in cognitive science, and describe a small experiment. Finally, we sketch a model of semantics unified through words-as-classifiers.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 49 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
13 of 49 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2016Visual Dialogcited by 377
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 195
- 2016Multiplex lexical networks reveal patterns in early word acquisition in childrencited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.