Novel Aficionados and Doppelg"angers: a referential task for semantic representations of individual entities
Not on the map. Why?
Abstract (arXiv)
In human semantic cognition, proper names (names which refer to individual entities) are harder to learn and retrieve than common nouns. This seems to be the case for machine learning algorithms too, but the linguistic and distributional reasons for this behaviour have not been investigated in depth so far. To tackle this issue, we show that the semantic distinction between proper names and common nouns is reflected in their linguistic distributions by employing an original task for distributional semantics, the Doppelg"anger test, an extensive set of models, and a new dataset, the Novel Aficionados dataset. The results indicate that the distributional representations of different individual entities are less clearly distinguishable from each other than those of common nouns, an outcome which intriguingly mirrors human cognition.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 20 Apr 2021.
Builds on
21 of 54 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2018Deep contextualized word representationscited by 2,285
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2019oLMpics -- On what Language Model Pre-training Capturescited by 161
- 2014word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding methodcited by 109
- 2016Improving Coreference Resolution by Learning Entity-Level Distributed Representationscited by 50
- 2020Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linkingcited by 49
- 2019Fine-Grained Entity Typing for Domain Independent Entity Linkingcited by 36
9 more
- 2020What's in a Name? Are BERT Named Entity Representations just as Good for any other Name?cited by 17
- 2017High-risk learning: acquiring new word vectors from tiny datacited by 13
- 2019Extraction and Analysis of Fictional Character Networks: A Surveycited by 13
- 2018Jointly Embedding Entities and Text with Distant Supervisioncited by 7
- 2017Whodunnit? Crime Drama as a Case for Natural Language Understandingcited by 6
- 2019EntEval: A Holistic Evaluation Benchmark for Entity Representationscited by 6
- 2019What do Entity-Centric Models Learn? Insights from Entity Linking in Multi-Party Dialoguecited by 4
- 2018Instantiationcited by 3
- 2019Word Embeddings for Entity-annotated Textscited by 2
Built on by
Not cited yet.