mlsanityData to 7 Oct 2026

Measuring Dataset Diversity from a Geometric Perspective

arXiv 2602.09340 ↗First posted 10 Feb 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Diversity can be broadly defined as the presence of meaningful variation across elements, which can be viewed from multiple perspectives, including statistical variation and geometric structural richness in the dataset. Existing diversity metrics, such as feature-space dispersion and metric-space magnitude, primarily capture distributional variation or entropy, while largely neglecting the geometric structure of datasets. To address this gap, we introduce a framework based on topological data analysis (TDA) and persistence landscapes (PLs) to extract and quantify geometric features from data. This approach provides a theoretically grounded means of measuring diversity beyond entropy, capturing the rich geometric and structural properties of datasets. Through extensive experiments across diverse modalities, we demonstrate that our proposed PLs-based diversity metric (PLDiv) is powerful, reliable, and interpretable, directly linking data diversity to its underlying geometry and offering a foundational tool for dataset construction, augmentation, and evaluation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

33 of 61 references.

References · 33

  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  4. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  5. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  6. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  7. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  8. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  9. 2023Self-Consuming Generative Models Go MADcited by 239
  10. 2021Data Augmentation Can Improve Robustnesscited by 193
  11. 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
  12. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
21 more
  1. 2020Evaluating the Evaluation of Diversity in Natural Language Generationcited by 127
  2. 2023On the Stability of Iterative Retraining of Generative Models on their own Datacited by 98
  3. 2020Improving Generalization in Reinforcement Learning with Mixture Regularizationcited by 81
  4. 2019Learning metrics for persistence-based summaries and applications for graph classificationcited by 57
  5. 2021Diversity and Generalization in Neural Network Ensemblescited by 32
  6. 2021Representation Matters: Assessing the Importance of Subgroup Allocations in Training Datacited by 31
  7. 2022Semantic Diversity in Dialogue with Natural Language Inferencecited by 28
  8. 2019When does Diversity Help Generalization in Classification Ensembles?cited by 27
  9. 2024Exploring Precision and Recall to assess the quality and diversity of LLMscited by 27
  10. 2019Persistent homology detects curvaturecited by 25
  11. 2024Scaling Data Diversity for Fine-Tuning Language Models in Human Alignmentcited by 25
  12. 2024Towards a Scalable Reference-Free Evaluation of Generative Modelscited by 25
  13. 2020DQI: Measuring Data Quality in NLPcited by 23
  14. 2020Diversity, Density, and Homogeneity: Quantitative Characteristic Metrics for Text Collectionscited by 21
  15. 2022On the effectiveness of persistent homologycited by 20
  16. 2023Metric Space Magnitude for Evaluating the Diversity of Latent Representationscited by 16
  17. 2014Using persistent homology and dynamical distances to analyze protein bindingcited by 15
  18. 2022Data Representativity for Machine Learning and AI Systemscited by 15
  19. 2023Why Can't Discourse Parsing Generalize? A Thorough Investigation of the Impact of Data Diversitycited by 15
  20. 2025Measuring Diversity in Synthetic Datasetscited by 5
  21. 2015A Geometric Perspective on Sparse Filtrationscited by 2

Built on by

Not cited yet.