Language Identification via Compositional Data Analysis: A Linear-Time Classifier Based on Log-Ratio Geometry
Not on the map. Why?
Abstract (arXiv)
Language identification is commonly addressed using either neural architectures or statistical n-gram models. Neural approaches typically require substantial computational resources, whereas classical frequency-based methods offer efficient linear-time performance, but rely on distance metrics that are not always appropriate for compositional data. This work models character and bigram frequency distributions as compositional vectors constrained to the simplex and mapped via the centered log-ratio (CLR) transformation bijectively onto the (D-1)-dimensional zero-sum subspace of ℝD, where Euclidean distances correspond to Aitchison distances. A pipeline is proposed, combining CLR-transformed unigram and bigram features with Laplace smoothing to address sparsity. The method is evaluated on six languages. Experimental results show that the proposed approach achieves robust accuracy across different text lengths, with strong performance for longer sequences. These findings indicate that compositional representations provide a deterministic and computationally efficient alternative for language identification, particularly in settings where interpretability and low resource consumption are essential.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 29 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
5 of 29 references.
References · 5
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2016FastText.zip: Compressing text classification modelscited by 335
- 2018Automatic Language Identification for Romance Languages using Stop Words and Diacriticscited by 2
Built on by
Not cited yet.