Learning Transfers: Kan Extensions of Topological Invariants of Learned Representations
Not on the map. Why?
Abstract (arXiv)
When a learned representation is reused for a new task, which of its structure should survive? A task is a small category, a change of task is a functor J, and the invariants of a trained representation form a functor F. The left Kan extension operatornameLanJF is the invariant that the source and the change of task force on the target: by its universal property, every comparison of the source with an observed target invariant factors through it. The transfer discrepancy is the largest distance, over the target objects, between this extension and the observed invariant. For persistent homology the extension is a cokernel over comma categories, and a functorial version of the discrepancy, which also compares the maps between target objects, is 1-Lipschitz under interleavings. On finite samples the discrepancy is a bottleneck distance, computed without approximation. For data glued from two pieces whose exclusive parts lie farther apart than the filtration scale, a Mayer-Vietoris sequence identifies what extending homology loses, while extending chains loses nothing. For a merge of labelled point clouds, the degree-zero discrepancy vanishes if and only if some 1-Lipschitz classifier has a margin above the filtration scale at every sample point. In experiments on sampled manifolds, trained encoders and pretrained image models, every exact prediction holds on every sample. The discrepancy of truncated invariants recovers a hidden merge of separated parts far above chance and tells the intended target of a merge from a permuted control, but across pretrained models it does not track the accuracy of a linear probe.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
26 of 45 references.
References · 26
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019Augmented Neural ODEscited by 397
- 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 174
- 2019Topological Autoencoderscited by 127
- 2019Ripser: efficient computation of Vietoris-Rips persistence barcodescited by 117
- 2020Topology of deep neural networkscited by 112
- 2019A Topology Layer for Machine Learningcited by 80
- 2018Neural Persistence: A Complexity Measure for Deep Neural Networks Using Algebraic Topologycited by 73
- 2021Representation Topology Divergence: A Method for Comparing Neural Network Representationscited by 66
- 2018A Topological Regularizer for Classifiers via Persistent Homologycited by 63
- 2019Connectivity-Optimized Representation Learning via Persistent Homologycited by 44
14 more
- 2016Geometry Helps to Compare Persistence Diagramscited by 39
- 2018Topological Data Analysis of Decision Boundaries with Application to Model Selectioncited by 19
- 2013Metrics for generalized persistence modulescited by 3
- 2018Computing the interleaving distance is NP-hardcited by 3
- 2019Persistent Homology as Stopping-Criterion for Voronoi Interpolationcited by 3
- 2020Estimate of the Neural Network Dimension using Algebraic Topology and Lie Theorycited by 3
- 2022Kan Extensions in Data Science and Machine Learningcited by 3
- 2026Kan Extension Transformers: A Categorical Unification of Attention, Diffusion, and Predict-Detach Self-Conditioningcited by 3
- 2021Domain Adaptation by Topology Regularizationcited by 2
- 2022Fast Left Kan Extensions Using The Chasecited by 2
- 2025Topological Signatures of ReLU Neural Network Activation Patternscited by 2
- 2021Homological Time Series Analysis of Sensor Signals from Power Plantscited by 1
- 2025Learning Is a Kan Extensioncited by 1
- 2025Kan Approximations of the Persistent Homology Transformcited by 1
Built on by
Not cited yet.