Predict Training Data Quality via Its Geometry in Metric Space
Not on the map. Why?
Abstract (arXiv)
High-quality training data is the foundation of machine learning and artificial intelligence, shaping how models learn and perform. Although much is known about what types of data are effective for training, the impact of the data's geometric structure on model performance remains largely underexplored. We propose that both the richness of representation and the elimination of redundancy within training data critically influence learning outcomes. To investigate this, we employ persistent homology to extract topological features from data within a metric space, thereby offering a principled way to quantify diversity beyond entropy-based measures. Our findings highlight persistent homology as a powerful tool for analyzing and enhancing the training data that drives AI systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 31 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
12 of 31 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 87
- 2019Learning metrics for persistence-based summaries and applications for graph classificationcited by 57
- 2021Representation Matters: Assessing the Importance of Subgroup Allocations in Training Datacited by 31
- 2019Automatically Identifying Complaints in Social Mediacited by 25
- 2023Metric Space Magnitude for Evaluating the Diversity of Latent Representationscited by 16
- 2022Data Representativity for Machine Learning and AI Systemscited by 15
- 2024Fill In The Gaps: Model Calibration and Generalization with Synthetic Datacited by 8
- 2022Protoformer: Embedding Prototypes for Transformerscited by 6
Built on by
Not cited yet.