A Crosslingual Investigation of Conceptualization in 1335 Languages
Not on the map. Why?
Abstract (arXiv)
Languages differ in how they divide up the world into concepts and words; e.g., in contrast to English, Swahili has a single concept for `belly' and `womb'. We investigate these differences in conceptualization across 1,335 languages by aligning concepts in a parallel corpus. To this end, we propose Conceptualizer, a method that creates a bipartite directed alignment graph between source language concepts and sets of target language strings. In a detailed linguistic analysis across all languages for one concept (`bird') and an evaluation on gold standard data for 32 Swadesh concepts, we show that Conceptualizer has good alignment accuracy. We demonstrate the potential of research on conceptualization in NLP with two experiments. (1) We define crosslingual stability of a concept as the degree to which it has 1-1 correspondences across languages, and show that concreteness predicts stability. (2) We represent each language by its conceptualization pattern for 83 concepts, and define a similarity measure on these representations. The resulting measure for the conceptual similarity of two languages is complementary to standard genealogical, typological, and surface similarity measures. For four out of six language families, we can assign languages to their correct family based on conceptual similarity with accuracy between 54% and 87%.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 12 of its 68 references that are in the map. First posted on arXiv 15 May 2023.
Builds on
12 of 68 references.
References · 12
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2019How multilingual is Multilingual BERT?cited by 645
- 2020Are All Languages Created Equal in Multilingual BERT?cited by 207
- 2018Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processingcited by 63
- 2020End-to-End Neural Word Alignment Outperforms GIZA++cited by 28
- 2017Semantic Structure and Interpretability of Word Embeddingscited by 21
- 2017Past, Present, Future: A Computational Investigation of the Typology of Tense in 1000 Languagescited by 13
- 2023Language Embeddings Sometimes Contain Typological Generalizationscited by 9
- 2022Towards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languagescited by 8
- 2021MirrorAlign: A Super Lightweight Unsupervised Word Alignment Model via Cross-Lingual Contrastive Learningcited by 4
- 2022CaMEL: Case Marker Extraction without Labelscited by 3
- 2020Neural Baselines for Word Alignmentcited by 2
Built on by
Citing papers per year: 2023: 6; 2024: 5.
11 papers.
- 2023OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretrainingcited by 37
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphscited by 11
- 2023Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understandingcited by 7
- 2023GradSim: Gradient-Based Language Grouping for Effective Multilingual Trainingcited by 6
- 2023A study of conceptual language similarity: comparison and evaluationcited by 3
- 2023X-PARADE: Cross-Lingual Textual Entailment and Information Divergence across Paragraphscited by 3
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
- 2024LangSAMP: Language-Script Aware Multilingual Pretrainingcited by 2
- 2024Patterns of Persistence and Diffusibility across the World's Languagescited by 0
- 2024Assessing the Role of Lexical Semantics in Cross-lingual Transfer through Controlled Manipulationscited by 0
- 2024A Top-down Graph-based Tool for Modeling Classical Semantic Maps: A Crosslinguistic Case Study of Supplementary Adverbscited by 0
- 2024A Top-down Graph-based Tool for Modeling Classical Semantic Maps: A Crosslinguistic Case Study of Supplementary Adverbs2 Dec 2024
- 2024LangSAMP: Language-Script Aware Multilingual Pretraining26 Sep 2024
- 2024Assessing the Role of Lexical Semantics in Cross-lingual Transfer through Controlled Manipulations14 Aug 2024
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions16 Jun 2024
- 2024Patterns of Persistence and Diffusibility across the World's Languages3 Jan 2024
- 2023OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining15 Nov 2023
- 2023GradSim: Gradient-Based Language Grouping for Effective Multilingual Training23 Oct 2023
- 2023X-PARADE: Cross-Lingual Textual Entailment and Information Divergence across Paragraphs16 Sep 2023
- 2023Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding15 Jul 2023
- 2023A study of conceptual language similarity: comparison and evaluation22 May 2023
- 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs22 May 2023