mlsanityData to 14 Oct 2026

REWA: A General Theory of Witness-Based Similarity

arXiv 2511.19998 ↗First posted 25 Nov 2025cs.LG cs.DS cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

We present a universal framework for similarity-preserving encodings that subsumes all discrete, continuous, algebraic, and learned similarity methods under a single theoretical umbrella. By formulating similarity as functional witness projection over monoids, we prove that [ O!left(frac1Delta2log Nright) ] encoding complexity with ranking preservation holds for arbitrary algebraic structures. This unification reveals that Bloom filters, Locality Sensitive Hashing (LSH), Count-Min sketches, Random Fourier Features, and Transformer attention kernels are instances of the same underlying mechanism. We provide complete proofs with explicit constants under 4-wise independent hashing, handle heavy-tailed witnesses via normalization and clipping, and prove [ O(log N) ] complexity for all major similarity methods from 1970-2024. We give explicit constructions for Boolean, Natural, Real, Tropical, and Product monoids, prove tight concentration bounds, and demonstrate compositional properties enabling multi-primitive similarity systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 1 of its 5 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

1 of 5 references.

References · 1

  1. 2017Attention Is All You Needcited by 60,361

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.