REWA: A General Theory of Witness-Based Similarity
Not on the map. Why?
Abstract (arXiv)
We present a universal framework for similarity-preserving encodings that subsumes all discrete, continuous, algebraic, and learned similarity methods under a single theoretical umbrella. By formulating similarity as functional witness projection over monoids, we prove that [ O!left(frac1Delta2log Nright) ] encoding complexity with ranking preservation holds for arbitrary algebraic structures. This unification reveals that Bloom filters, Locality Sensitive Hashing (LSH), Count-Min sketches, Random Fourier Features, and Transformer attention kernels are instances of the same underlying mechanism. We provide complete proofs with explicit constants under 4-wise independent hashing, handle heavy-tailed witnesses via normalization and clipping, and prove [ O(log N) ] complexity for all major similarity methods from 1970-2024. We give explicit constructions for Boolean, Natural, Real, Tropical, and Product monoids, prove tight concentration bounds, and demonstrate compositional properties enabling multi-primitive similarity systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 1 of its 5 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
1 of 5 references.
References · 1
- 2017Attention Is All You Needcited by 60,361
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025The Information Theory of Similaritycited by 0
- 2025The Information Theory of Similarity29 Nov 2025