Certified Topological Interaction in Neural Representations: Exact Tests and the Statistic They Require
Not on the map. Why?
Abstract (arXiv)
Class disentanglement--the separation of a representation's class-conditional point clouds along depth and over training--is measured by descriptive curves: the sentence such a study wants to write, layer l+1 is more disentangled than layer l, is an eyeball judgement with no null. We supply the inferential layer for a topological measurement of class overlap, the Intersection Euler Characteristic Profile: the Euler characteristic of the overlap of the clouds' ball unions as a function of scale, from one Alpha-complex sweep with no boundary-matrix reduction. Every number carries a test--exact permutation tests in both directions, a guarded separation certificate the invariant requires, and a paired sign-flip test for comparative claims. Building that test taught a lesson outliving this invariant: its statistic must be scale-free. On the raw profile mass, which has units of feature length, 12,375 paired tests return 5,633 significant steps of which every one at the first epoch points the wrong way, certifying feature-norm dynamics as disentanglement; the dimensionless statistic returns 2,707, with 2,026 decreases. Across 111 networks and 52,650 measurements, disentanglement is depth-graded and early, and interaction quotients rank class pairs by confusability (rho=0.83), on par with cheap separability statistics. In a 96-model factorial, augmentation is the one training choice that separates classes relative to chance; weight decay compresses the overlap without separating. Only a k-fold statistic can pose the structural question: the joint entanglement of a class triple sits below its strongest pair in 97% of triple-layer cells and 99.5% of deep cells, at median ratios far below a measured null floor, in vision encoders and frozen language models--a regularity, not a law. The unnormalized mass predicts test accuracy (R^2=0.94), the quotient does not, and neither beats a linear probe.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 58 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
35 of 58 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2019Fantastic Generalization Measures and Where to Find Themcited by 513
23 more
- 2019Intrinsic dimension of data representations in deep neural networkscited by 282
- 2016Revisiting Classifier Two-Sample Testscited by 268
- 2019Topological Autoencoderscited by 127
- 2020Topology of deep neural networkscited by 112
- 2018Neural Persistence: A Complexity Measure for Deep Neural Networks Using Algebraic Topologycited by 73
- 2021On the geometry of generalization and memorization in deep neural networkscited by 73
- 2021Intrinsic Dimension, Persistent Homology and Generalization in Neural Networkscited by 70
- 2018A Topological Regularizer for Classifiers via Persistent Homologycited by 63
- 2020Computing the Testing Error without a Testing Setcited by 54
- 2018How deep is deep enough? -- Quantifying class separability in the hidden layers of deep neural networkscited by 28
- 2022On the effectiveness of persistent homologycited by 20
- 2018Topological Data Analysis of Decision Boundaries with Application to Model Selectioncited by 19
- 2023Differentiable Euler Characteristic Transforms for Shape Classificationcited by 18
- 2023Euler Characteristic Tools For Topological Data Analysiscited by 13
- 2013Hypothesis Testing for Topological Data Analysiscited by 9
- 2022Euler Characteristic Curves and Profiles: a stable shape invariant for big data problemscited by 8
- 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classificationcited by 4
- 2026Statistical Inference for Persistence Diagrams via Landmark Embeddings: Minimax Theory and Finite Approximationcited by 4
- 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classificationcited by 3
- 2024Mixup Barcodes: Quantifying Geometric-Topological Interactions between Point Cloudscited by 2
- 2026The Intersection Euler Characteristic Profile: Euler Calculus and Stability for Topological Interaction of Ball Unionscited by 2
- 2022Topology-Driven Goodness-of-Fit Tests in Arbitrary Dimensionscited by 1
- 2024Chromatic Topological Data Analysiscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling Laws
- 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds
- 2026When Models Don't Manipulate Manifolds: The Geometry of a Comparison Task
- 2026Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
- 2026Representation Gap: Explaining the Unreasonable Effectiveness of Neural Networks from a Geometric Perspective
- 2026What Converges in the Platonic Representation Hypothesis? Structure over Geometry
- 2026The Geometric Price of Discrete Logic: Context-driven Manifold Dynamics of Number Representations
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fields