mlsanityData to 7 Oct 2026

Symmetric Divergence and Normalized Similarity: A Unified Topological Framework for Representation Analysis

arXiv 2606.06342 ↗First posted 4 Jun 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Topological Data Analysis (TDA) offers a principled, intrinsic lens for comparing neural representations. However, existing paired topological divergences (e.g., RTD) are limited by heuristic asymmetry and, more critically, unbounded scores that depend on sample size, hindering reliable cross-scenario benchmarking. To address these challenges, we develop a unified topological toolkit serving two complementary needs: fine-grained structural diagnosis and robust, standardized evaluation. First, we complete the RTD framework by introducing Symmetric Representation Topology Divergence (SRTD) and its efficient variant SRTD-lite. Beyond resolving the theoretical asymmetry of prior variants, SRTD consolidates diagnostic information into a single, comprehensive cross-barcode signature. This allows for precise localization of structural discrepancies and serves as an effective optimization objective without the overhead of dual directional computations. Second, to enable reliable benchmarking across heterogeneous settings, we propose Normalized Topological Similarity (NTS). By measuring the rank correlation of hierarchical merge orders, NTS yields a scale-invariant metric bounded between -1 and 1, effectively overcoming the scale and sample-dependence of unnormalized divergences. Experiments across synthetic and real-world deep learning settings demonstrate that our toolkit captures functional shifts in CNNs missed by geometric measures and robustly maps LLM genealogy even under distance saturation, offering a rigorous, topology-aware perspective that complements measures like CKA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

33 of 47 references.

References · 33

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  5. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  6. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
  7. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  8. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  9. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  10. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
  11. 2024InternLM2 Technical Reportcited by 391
  12. 2018Insights on representational similarity in neural networks with canonical correlationcited by 318
21 more
  1. 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
  2. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 235
  3. 2015Convergent Learning: Do different neural networks learn the same representations?cited by 215
  4. 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
  5. 2017An introduction to Topological Data Analysis: fundamental and practical aspects for data scientistscited by 171
  6. 2020Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualizationcited by 170
  7. 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
  8. 2021Similarity and Matching of Neural Network Representationscited by 77
  9. 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 74
  10. 2021Representation Topology Divergence: A Method for Comparing Neural Network Representationscited by 66
  11. 2018Geometry Score: A Method For Comparing Generative Adversarial Networkscited by 56
  12. 2019The Shape of Data: Intrinsic Distance for Data Distributionscited by 38
  13. 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 34
  14. 2021On UMAP's true loss functioncited by 32
  15. 2021Manifold Topology Divergence: a Framework for Comparing Data Manifoldscited by 31
  16. 2023Learning Topology-Preserving Data Representationscited by 30
  17. 2020GPU-Accelerated Computation of Vietoris-Rips Persistence Barcodescited by 26
  18. 2023Complexity Matters: Rethinking the Latent Space for Generative Modelingcited by 19
  19. 2023Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalizationcited by 14
  20. 2021Quantitative Performance Assessment of CNN Units via Topological Entropy Calculationcited by 6
  21. 2025RTD-Lite: Scalable Topological Analysis for Comparing Weighted Graphs in Learning Taskscited by 4

Built on by

Not cited yet.