mlsanityData to 7 Oct 2026

emb-diversity: A Tool for Embedding-Based Measurement of Data Diversity

arXiv 2607.19848 ↗First posted 22 Jul 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

There is growing evidence that data diversity is crucial for developing fair and robust NLP models. However, current approaches to measure diversity remain inconsistent and fragmented: While there exist a number of tools for measuring the lexical diversity of texts, researchers lack standardized tools for quantifying diversity based on embeddings. Embedding-based diversity measures are highly flexible: They work with any embedding model and any data that can be embedded, and are thus applicable to many notions of diversity. With emb-diversity, we provide a comprehensive embedding-based diversity measurement tool, spanning a broad range of measures. We demonstrate its potential for several use cases: measuring the stylistic, semantic, language and speaker diversity of datasets. https://github.com/nlpsoc/emb-diversity/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 58 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

32 of 58 references.

References · 32

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  3. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  4. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  5. 2020Evaluating the Evaluation of Diversity in Natural Language Generationcited by 127
  6. 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Textcited by 97
  7. 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
  8. 2023Data Diversity Matters for Robust Instruction Tuningcited by 76
  9. 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
  10. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  11. 2024Diversity Measurement and Subset Selection for Instruction Tuning Datasetscited by 28
  12. 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
20 more
  1. 2025The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Textcited by 25
  2. 2025Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable Metriccited by 24
  3. 2021Directed Diversity: Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideationcited by 23
  4. 2020Diversity, Density, and Homogeneity: Quantitative Characteristic Metrics for Text Collectionscited by 21
  5. 2023Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Datacited by 19
  6. 2024Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learningcited by 19
  7. 2025Post-training Large Language Models for Diverse High-Quality Responsescited by 19
  8. 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
  9. 2025Diversity as a Reward: Fine-Tuning LLMs on a Mixture of Domain-Undetermined Datacited by 13
  10. 2024A Principled Framework for Evaluating on Typologically Diverse Languagescited by 12
  11. 2024A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Setscited by 10
  12. 2025SampleMix: A Sample-wise Pre-training Data Mixing Strategey by Coordinating Data Quality and Diversitycited by 10
  13. 2025Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Modelscited by 9
  14. 2024Challenges of Generating Structurally Diverse Graphscited by 6
  15. 2025Evaluating the Evaluation of Diversity in Commonsense Generationcited by 5
  16. 2025Limits of LLM Text Detectors in Educationcited by 5
  17. 2022Diversity Over Size: On the Effect of Sample and Topic Sizes for Topic-Dependent Argument Mining Datasetscited by 4
  18. 2024Variationist: Exploring Multifaceted Variation and Bias in Written Language Datacited by 3
  19. 2025We Need to Measure Data Diversity in NLP -- Better and Broadercited by 2
  20. 2025Privacy-Preserving Synthetic Review Generation with Diverse Writing Styles Using LLMscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026MegaStyle++: Scaling Image Style Space through Hierarchical Style Definitioncited by 0