mlsanityData to 14 Oct 2026

Sub-Quadratic Bisimulation Metrics via Approximate Nearest Neighbors: Coverage-Augmented Guarantees and Computable Two-Sided Certificates

arXiv 2608.06762 ↗First posted 7 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Bisimulation metrics quantify behavioral similarity in Markov decision processes, but their Wasserstein fixed-point operator updates every state pair and incurs quadratic pairwise work. We give a certificate-carrying sub-quadratic method for MDPs with bounded transition support and a useful low-dimensional indexing representation: an approximate-nearest-neighbor index selects the pairs updated by the exact restricted operator, while monotone lower and upper runs enclose the exact metric at every sweep. The main analytical result is a coverage-augmented anytime bound: local index quality alone cannot control global error, because uncovered pairs retain their initialization gap. The limiting error is at most max(ρ,eop/(1-γ)), and with exact covered backups the lower arm satisfies |dann-d|_∞=ρ. Because ρ depends on the unknown exact metric, the algorithm returns the observable sandwich width instead; agreement of the induced lower and upper clusterings certifies exact recovery of the covered aggregation. A reward-oblivious lower bound shows sub-quadratic index-first coverage cannot remove the coverage term, while a separate adaptive lower bound requires Omega(|Scal|) pair evaluations. Exact-operator experiments verify the identity and enclosure in every seeded run, and timing experiments recover quadratic versus sub-quadratic scaling under both cheap and full Wasserstein backups. On the grouped |Scal|=64 benchmark, exact restricted refinement reaches the exact-metric skyline once retrieval covers roughly half of all pairs, while independently trained MICo and DBC baselines stay 22-33× above that skyline at every retrieval budget. Taxi shows the certificate abstaining under an uninformative embedding, while a 2500-state gridworld improves over a reward-only metric by 28.6% using 12.8% of one quadratic sweep.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 58 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

17 of 58 references.

References · 17

  1. 2017Billion-scale similarity search with GPUscited by 2,497
  2. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  3. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  4. 2018Computational Optimal Transportcited by 780
  5. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
  6. 2019DeepMDP: Learning Continuous Latent Space Models for Representation Learningcited by 207
  7. 2019Scalable methods for computing state similarity in deterministic Markov Decision Processescited by 133
  8. 2018ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithmscited by 130
  9. 2021Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learningcited by 123
  10. 2017Near Optimal Behavior via Approximate State Abstractioncited by 66
  11. 2021Towards Robust Bisimulation Metric Learningcited by 49
  12. 2018Approximate Nearest Neighbor Search in High Dimensionscited by 47
5 more
  1. 2021MICo: Improved representations via sampling-based state similarity for Markov decision processescited by 43
  2. 2014Hashing for Similarity Search: A Surveycited by 34
  3. 2022On the Generalization of Representations in Reinforcement Learningcited by 28
  4. 2021Metrics and continuity in reinforcement learningcited by 26
  5. 2013Model Reduction Techniques for Computing Approximately Optimal Solutions for Markov Decision Processescited by 10

Built on by

Not cited yet.