mlsanityData to 14 Oct 2026

Batch Aggregation: An Approach to Enhance Text Classification with Correlated Augmented Data

arXiv 2504.05020 ↗First posted 7 Apr 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Natural language processing models often face challenges due to limited labeled data, especially in domain specific areas, e.g., clinical trials. To overcome this, text augmentation techniques are commonly used to increases sample size by transforming the original input data into artificial ones with the label preserved. However, traditional text classification methods ignores the relationship between augmented texts and treats them as independent samples which may introduce classification error. Therefore, we propose a novel approach called 'Batch Aggregation' (BAGG) which explicitly models the dependence of text inputs generated through augmentation by incorporating an additional layer that aggregates results from correlated texts. Through studying multiple benchmark data sets across different domains, we found that BAGG can improve classification accuracy. We also found that the increase of performance with BAGG is more obvious in domain specific data sets, with accuracy improvements of up to 10-29%. Through the analysis of benchmark data, the proposed method addresses limitations of traditional techniques and improves robustness in text classification tasks. Our result demonstrates that BAGG offers more robust results and outperforms traditional approaches when training data is limited.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 57 references that are in the map. First posted on arXiv 7 Apr 2025.

Builds on

35 of 57 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  8. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  9. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  10. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  11. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  12. 2023Whose Opinions Do Language Models Reflect?cited by 773
23 more
  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  2. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
  3. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
  4. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  5. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
  6. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
  7. 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
  8. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 211
  9. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  10. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  11. 2024A Roadmap to Pluralistic Alignmentcited by 184
  12. 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
  13. 2023Aligning Language Models to User Opinionscited by 99
  14. 2018Language GANs Falling Shortcited by 97
  15. 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
  16. 2022ProGen: Progressive Zero-shot Dataset Generation via In-context Feedbackcited by 67
  17. 2023On the steerability of large language models toward data-driven personascited by 53
  18. 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
  19. 2024Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinementcited by 49
  20. 2024EDT: Improving Large Language Models' Generation by Entropy-based Dynamic Temperature Samplingcited by 45
  21. 2024Few-shot Personalization of LLMs with Mis-aligned Responsescited by 32
  22. 2024PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learningcited by 29
  23. 2023ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrievalcited by 26

Built on by

Not cited yet.