mlsanityData to 14 Oct 2026

Geometric Filtering of LLM-Generated Samples for Few-Shot Text Classification

arXiv 2608.13866 ↗First posted 14 Aug 2026cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) can generate synthetic training data for text classification, but the quality of generated samples is heterogeneous: some fall in correct class regions of the embedding space while others land in peripheral or cross-class zones. We propose a geometric filtering framework that evaluates each LLM-generated sample by its Euclidean distance to real class examples in a sentence embedding space, selecting only geometrically consistent candidates. A soft weighting mechanism transforms filter scores into sample weights for classifier training. Evaluated across 13 datasets, 5 classifiers, 10 augmentation methods, and over 6,700 configurations, our method achieves +2.61 percentage points (pp) over SMOTE (p<0.0001, Cohen's d=0.95, 88.9% win rate). The approach generalizes to named entity recognition (+9.26pp, 100% win rate) without filter modification, and is robust across 5 LLMs from 4 providers. A key finding is that the simplest distance-based filter consistently outperforms complex multi-criteria alternatives.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

13 of 27 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  5. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  6. 2021A Survey of Data Augmentation Approaches for NLPcited by 409
  7. 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
  8. 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 100
  9. 2025Token embeddings violate the manifold hypothesiscited by 16
  10. 2024Surpassing Cosine Similarity for Multidimensional Comparisons: Dimension Insensitive Euclidean Metriccited by 9
  11. 2024LLMs vs Established Text Augmentation Techniques for Classification: When do the Benefits Outweight the Costs?cited by 8
  12. 2025Disentangling the Roles of Representation and Selection in Data Pruningcited by 4
1 more
  1. 2025SMOTExT: SMOTE meets Large Language Modelscited by 3

Built on by

Not cited yet.