mlsanityData to 7 Oct 2026

Topological quantification of ambiguity in semantic search

arXiv 2406.07990 ↗First posted 12 Jun 2024cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We studied how the local topological structure of sentence-embedding neighborhoods encodes semantic ambiguity. Extending ideas that link word-level polysemy to non-trivial persistent homology, we generalized the concept to full sentences and quantified ambiguity of a query in a semantic search process with two persistent homology metrics: the 1-Wasserstein norm of H0 and the maximum loop lifetime of H1. We formalized the notion of ambiguity as the relative presence of semantic domains or topics in sentences. We then used this formalism to compute "ab-initio" simulations that encode datapoints as linear combination of randomly generated single topics vectors in an arbitrary embedding space and demonstrate that ambiguous sentences separate from unambiguous ones in both metrics. Finally we validated those findings with real-world case by investigating on a fully open corpus comprising Nobel Prize Physics lectures from 1901 to 2024, segmented into contiguous, non-overlapping chunks at two granularity: ~!250 tokens and ~!750 tokens. We tested embedding with four publicly available models. Results across all models reproduce simulations and remain stable despite changes in embedding architecture. We conclude that persistent homology provides a model-agnostic signal of semantic discontinuities, suggesting practical use for ambiguity detection and semantic search recall.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 12 Jun 2024.

Builds on

11 of 23 references.

References · 11

  1. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  2. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  3. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 201
  4. 2021SPLADE v2: Sparse Lexical and Expansion Model for Information Retrievalcited by 126
  5. 2024Is Cosine-Similarity of Embeddings Really About Similarity?cited by 89
  6. 2020giotto-tda: A Topological Data Analysis Toolkit for Machine Learning and Data Explorationcited by 55
  7. 2022Problems with Cosine as a Measure of Embedding Similarity for High Frequency Wordscited by 49
  8. 2016Geometry Helps to Compare Persistence Diagramscited by 38
  9. 2020Topology of Word Embeddings: Singularities Reflect Polysemycited by 15
  10. 2023Solving Cosine Similarity Underestimation between High Frequency Words by L2 Norm Discountingcited by 5
  11. 2021Unsupervised Sentence-embeddings by Manifold Approximation and Projectioncited by 4

Built on by

Not cited yet.