mlsanityData to 14 Oct 2026

CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples

arXiv 2508.21083 ↗First posted 26 Aug 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Deep learning models often learn and exploit spurious correlations in training data, using these non-target features to inform their predictions. Such reliance leads to performance degradation and poor generalization on unseen data. To address these limitations, we introduce a more general form of counterfactual data augmentation, termed counterbias data augmentation, which simultaneously tackles multiple biases (e.g., gender bias, simplicity bias) and enhances out-of-distribution robustness. We present CoBA: CounterBias Augmentation, a unified framework that operates at the semantic triple level: first decomposing text into subject-predicate-object triples, then selectively modifying these triples to disrupt spurious correlations. By reconstructing the text from these adjusted triples, CoBA generates counterbias data that mitigates spurious patterns. Through extensive experiments, we demonstrate that CoBA not only improves downstream task performance, but also effectively reduces biases and strengthens out-of-distribution resilience, offering a versatile and robust solution to the challenges posed by spurious correlations.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 55 of its 84 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

55 of 84 references.

References · 55

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  9. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  10. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  11. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  12. 2015A large annotated corpus for learning natural language inferencecited by 1,847
38 more
  1. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
  2. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  3. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  4. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  5. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  6. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  7. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
  8. 2018Recognition in Terra Incognitacited by 658
  9. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  10. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  11. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  12. 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
  13. 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 222
  14. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  15. 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
  16. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
  17. 2020Towards Debiasing Sentence Representationscited by 171
  18. 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
  19. 2018Conditional BERT Contextual Augmentationcited by 107
  20. 2022The Shapley Value in Machine Learningcited by 98
  21. 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
  22. 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 75
  23. 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
  24. 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
  25. 2023Explore Spurious Correlations at the Concept Level in Language Models for Text Classificationcited by 48
  26. 2020Contrastive Triple Extraction with Generative Transformercited by 44
  27. 2023Prompting Large Language Models for Counterfactual Generation: An Empirical Studycited by 37
  28. 2023How Re-sampling Helps for Long-Tail Learning?cited by 36
  29. 2022Are All Spurious Features in Natural Language Alike? An Analysis through a Causal Lenscited by 28
  30. 2023Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventionscited by 28
  31. 2021Influence Tuning: Demoting Spurious Correlations via Instance Attribution and Instance-Driven Updatescited by 27
  32. 2023CREST: A Joint Framework for Rationalization and Counterfactual Text Generationcited by 24
  33. 2024A Survey on Natural Language Counterfactual Generationcited by 21
  34. 2021Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extractioncited by 17
  35. 2023CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibrationcited by 17
  36. 2024Effects of diversity incentives on sample diversity and downstream model performance in LLM-based text augmentationcited by 17
  37. 2023Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysiscited by 11
  38. 2022Selection Bias Induced Spurious Correlations in Large Language Modelscited by 9

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.