mlsanityData to 7 Oct 2026

Monitoring Neural Training with Topology: A Footprint-Predictable Collapse Index

arXiv 2604.26984 ↗First posted 28 Apr 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Representational collapse, where embeddings become anisotropic and lose multi-scale structure, can erode downstream performance long before performance metrics react. We propose an online, topology-aware monitor for evolving neural representations that couples Modular Morse Homology Maintenance (MMHM) with a composite Collapse Index (CI). Instead of rebuilding complexes each epoch, we apply sparse edits at a fixed scale and maintain a discrete Morse matching, yielding fast, incremental updates. Across LLM fine-tuning and temporal KGE training, CI provides a low-latency early-warning signal suitable for in-training interventions. Code and experimental scripts will be released publicly

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 13 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

8 of 13 references.

References · 8

  1. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  2. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  3. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  4. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  5. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
  6. 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
  7. 2021IsoScore: Measuring the Uniformity of Embedding Space Utilizationcited by 52
  8. 2025Morse-based Modular Homology for Evolving Simplicial Complexescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.