Monitoring Neural Training with Topology: A Footprint-Predictable Collapse Index
Not on the map. Why?
Abstract (arXiv)
Representational collapse, where embeddings become anisotropic and lose multi-scale structure, can erode downstream performance long before performance metrics react. We propose an online, topology-aware monitor for evolving neural representations that couples Modular Morse Homology Maintenance (MMHM) with a composite Collapse Index (CI). Instead of rebuilding complexes each epoch, we apply sparse edits at a fixed scale and maintain a discrete Morse matching, yielding fast, incremental updates. Across LLM fine-tuning and temporal KGE training, CI provides a low-latency early-warning signal suitable for in-training interventions. Code and experimental scripts will be released publicly
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 13 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
8 of 13 references.
References · 8
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
- 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
- 2021IsoScore: Measuring the Uniformity of Embedding Space Utilizationcited by 52
- 2025Morse-based Modular Homology for Evolving Simplicial Complexescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026When Rank Rises as LLMs Degradecited by 0
- 2026When Rank Rises as LLMs Degrade7 Oct 2026