Semantic Cells: Evolutional Process to Acquire Sense Diversity of Items
Not on the map. Why?
Abstract (arXiv)
Previous models for learning the semantic vectors of items and their groups, such as words, sentences, nodes, and graphs, using distributed representation have been based on the assumption that the basic sense of an item corresponds to one vector composed of dimensions corresponding to hidden contexts in the target real world, from which multiple senses of the item are obtained by conforming to lexical databases or adapting to the context. However, there may be multiple senses of an item, which are hardly assimilated and change or evolve dynamically following the contextual shift even within a document or a restricted period. This is a process similar to the evolution or adaptation of a living entity with/to environmental shifts. Setting the scope of disambiguation of items for sensemaking, the author presents a method in which a word or item in the data embraces multiple semantic vectors that evolve via interaction with others, similar to a cell embracing chromosomes crossing over with each other. We obtained two preliminary results: (1) the role of a word that evolves to acquire the largest or lower-middle variance of semantic vectors tends to be explainable by the author of the text; (2) the epicenters of earthquakes that acquire larger variance via crossover, corresponding to the interaction with diverse areas of land crust, are likely to correspond to the epicenters of forthcoming large earthquakes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 60 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
18 of 60 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2018Deep contextualized word representationscited by 2,285
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2014Distributed Representations of Sentences and Documentscited by 677
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2016Item2Vec: Neural Item Embedding for Collaborative Filteringcited by 72
- 2019Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddingscited by 55
- 2018From Word to Sense Embeddings: A Survey on Vector Representations of Meaningcited by 49
- 2015Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Spacecited by 35
6 more
- 2015AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemescited by 19
- 2018Word Sense Induction with Neural biLM and Symmetric Patternscited by 18
- 2015Do Multi-Sense Embeddings Improve Natural Language Understanding?cited by 9
- 2016The Role of Context Types and Dimensionality in Learning Word Embeddingscited by 4
- 2015Syntax-Aware Multi-Sense Word Embeddings for Deep Compositional Models of Meaningcited by 3
- 2023Collect and Connect Data Leaves to Feature Concepts: Interactive Graph Generation Toward Well-beingcited by 1
Built on by
Not cited yet.