mlsanityData to 14 Oct 2026

Formalising lexical and syntactic diversity for data sampling in French

arXiv 2501.08003 ↗First posted 14 Jan 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Diversity is an important property of datasets and sampling data for diversity is useful in dataset creation. Finding the optimally diverse sample is expensive, we therefore present a heuristic significantly increasing diversity relative to random sampling. We also explore whether different kinds of diversity -- lexical and syntactic -- correlate, with the purpose of sampling for expensive syntactic diversity through inexpensive lexical diversity. We find that correlations fluctuate with different datasets and versions of diversity measures. This shows that an arbitrarily chosen measure may fall short of capturing diversity-related properties of datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 14 Jan 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.