What are the Goals of Distributional Semantics?
Not on the map. Why?
Abstract (arXiv)
Distributional semantic models have become a mainstay in NLP, providing useful features for downstream tasks. However, assessing long-term progress requires explicit long-term goals. In this paper, I take a broad linguistic perspective, looking at how well current models can deal with various semantic challenges. Given stark differences between models proposed in different subfields, a broad perspective is needed to see how we could integrate them. I conclude that, while linguistic insights can guide the design of model architectures, future progress will require balancing the often conflicting demands of linguistic expressiveness and computational tractability.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 2; 2024: 0; 2025: 1.
8 papers.
- 2021Word Acquisition in Neural Language Modelscited by 41
- 2021Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive Learningcited by 9
- 2025Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More Morecited by 3
- 2022Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Modelscited by 1
- 2022Learning Functional Distributional Semantics with Visual Datacited by 1
- 2023Agentivit`a e telicit`a in GilBERTo: implicazioni cognitivecited by 1
- 2022Using dependency parsing for few-shot learning in distributional semanticscited by 0
- 2023Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structurescited by 0
- 2025Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More13 Mar 2025
- 2023Agentivit`a e telicit`a in GilBERTo: implicazioni cognitive6 Jul 2023
- 2023Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures30 May 2023
- 2022Using dependency parsing for few-shot learning in distributional semantics12 May 2022
- 2022Learning Functional Distributional Semantics with Visual Data22 Apr 2022
- 2022Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models15 Mar 2022
- 2021Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive Learning13 Nov 2021
- 2021Word Acquisition in Neural Language Models5 Oct 2021