Vectoring Languages
Not on the map. Why?
Abstract (arXiv)
Recent breakthroughs in large language models (LLM) have stirred up global attention, and the research has been accelerating non-stop since then. Philosophers and psychologists have also been researching the structure of language for decades, but they are having a hard time finding a theory that directly benefits from the breakthroughs of LLMs. In this article, we propose a novel structure of language that reflects well on the mechanisms behind language models and go on to show that this structure is also better at capturing the diverse nature of language compared to previous methods. An analogy of linear algebra is adapted to strengthen the basis of this perspective. We further argue about the difference between this perspective and the design philosophy for current language models. Lastly, we discuss how this perspective can lead us to research directions that may accelerate the improvements of science fastest.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 16 Jul 2024.
Builds on
9 of 28 references.
References · 9
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 118
- 2020Word meaning in minds and machinescited by 51
- 2016Modeling Human Ad Hoc Coordinationcited by 1
Built on by
Not cited yet.