Beyond Cosine Similarity: Taming Semantic Drift and Antonym Intrusion in a 15-Million Node Turkish Synonym Graph
Not on the map. Why?
Abstract (arXiv)
Neural embeddings have a notorious blind spot: they can't reliably tell synonyms apart from antonyms. Consequently, increasing similarity thresholds often fails to prevent opposites from being grouped together. We've built a large-scale semantic clustering system specifically designed to tackle this problem head on. Our pipeline chews through 15 million lexical items, evaluates a massive 520 million potential relationships, and ultimately generates 2.9 million high-precision semantic clusters. The system makes three primary contributions. First, we introduce a labeled dataset of 843,000 concept pairs spanning synonymy, antonymy, and co-hyponymy, constructed via Gemini 2.5-Flash LLM augmentation and verified using human-curated dictionary resources. Second, we propose a specialized three-way semantic relation discriminator that achieves 90% macro-F1, enabling robust disambiguation beyond raw embedding similarity. Third, we introduce a novel soft-to-hard clustering algorithm that mitigates semantic drift preventing erroneous transitive chains (e.g., hot -> spicy -> pain -> depression) while simultaneously resolving polysemy. Our approach employs a topology-aware two-stage expansion-pruning procedure with topological voting, ensuring that each term is assigned to exactly one semantically coherent cluster. The resulting resource enables high-precision semantic search and retrieval-augmented generation, particularly for morphologically rich and low-resource languages where existing synonym databases remain sparse.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 44 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
8 of 44 references.
References · 8
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 385
- 2016Counter-fitting Word Vectors to Linguistic Constraintscited by 140
- 2021Exploring the Representation of Word Meanings in Context: A Case Study on Homonymy and Synonymycited by 9
- 2013Computing Lexical Contrastcited by 7
- 2017Watset: Automatic Induction of Synsets from a Graph of Synonymscited by 5
- 2025TurkEmbed4Retrieval: Turkish Embedding Model for Retrieval Taskcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Divergent large language model predictions from convergent representations in ambiguous word pairs
- 2026Adapting Multilingual Embedding Models to Turkish via Cross-Lingual Tokenizer Surgery and Offline Distillation
- 2026Do Language Models Encode Semantic Relations? Probing and Sparse Feature Analysis
- 2025Semantic Convergence: Investigating Shared Representations Across Scaled LLMs
- 2023Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models
- 2025Efficient Latent Semantic Clustering for Scaling Test-Time Computation of LLMs
- 2024MINERS: Multilingual Language Models as Semantic Retrievers
- 2025SAGE: A Realistic Benchmark for Semantic Understanding