Symmetric Divergence and Normalized Similarity: A Unified Topological Framework for Representation Analysis
Not on the map. Why?
Abstract (arXiv)
Topological Data Analysis (TDA) offers a principled, intrinsic lens for comparing neural representations. However, existing paired topological divergences (e.g., RTD) are limited by heuristic asymmetry and, more critically, unbounded scores that depend on sample size, hindering reliable cross-scenario benchmarking. To address these challenges, we develop a unified topological toolkit serving two complementary needs: fine-grained structural diagnosis and robust, standardized evaluation. First, we complete the RTD framework by introducing Symmetric Representation Topology Divergence (SRTD) and its efficient variant SRTD-lite. Beyond resolving the theoretical asymmetry of prior variants, SRTD consolidates diagnostic information into a single, comprehensive cross-barcode signature. This allows for precise localization of structural discrepancies and serves as an effective optimization objective without the overhead of dual directional computations. Second, to enable reliable benchmarking across heterogeneous settings, we propose Normalized Topological Similarity (NTS). By measuring the rank correlation of hierarchical merge orders, NTS yields a scale-invariant metric bounded between -1 and 1, effectively overcoming the scale and sample-dependence of unnormalized divergences. Experiments across synthetic and real-world deep learning settings demonstrate that our toolkit captures functional shifts in CNNs missed by geometric measures and robustly maps LLM genealogy even under distance saturation, offering a rigorous, topology-aware perspective that complements measures like CKA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
33 of 47 references.
References · 33
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2023Qwen Technical Reportcited by 3,273
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2023Baichuan 2: Open Large-scale Language Modelscited by 664
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2024InternLM2 Technical Reportcited by 391
- 2018Insights on representational similarity in neural networks with canonical correlationcited by 318
21 more
- 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
- 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 235
- 2015Convergent Learning: Do different neural networks learn the same representations?cited by 215
- 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
- 2017An introduction to Topological Data Analysis: fundamental and practical aspects for data scientistscited by 171
- 2020Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualizationcited by 170
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
- 2021Similarity and Matching of Neural Network Representationscited by 77
- 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 74
- 2021Representation Topology Divergence: A Method for Comparing Neural Network Representationscited by 66
- 2018Geometry Score: A Method For Comparing Generative Adversarial Networkscited by 56
- 2019The Shape of Data: Intrinsic Distance for Data Distributionscited by 38
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 34
- 2021On UMAP's true loss functioncited by 32
- 2021Manifold Topology Divergence: a Framework for Comparing Data Manifoldscited by 31
- 2023Learning Topology-Preserving Data Representationscited by 30
- 2020GPU-Accelerated Computation of Vietoris-Rips Persistence Barcodescited by 26
- 2023Complexity Matters: Rethinking the Latent Space for Generative Modelingcited by 19
- 2023Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalizationcited by 14
- 2021Quantitative Performance Assessment of CNN Units via Topological Entropy Calculationcited by 6
- 2025RTD-Lite: Scalable Topological Analysis for Comparing Weighted Graphs in Learning Taskscited by 4
Built on by
Not cited yet.