CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples
Not on the map. Why?
Abstract (arXiv)
Deep learning models often learn and exploit spurious correlations in training data, using these non-target features to inform their predictions. Such reliance leads to performance degradation and poor generalization on unseen data. To address these limitations, we introduce a more general form of counterfactual data augmentation, termed counterbias data augmentation, which simultaneously tackles multiple biases (e.g., gender bias, simplicity bias) and enhances out-of-distribution robustness. We present CoBA: CounterBias Augmentation, a unified framework that operates at the semantic triple level: first decomposing text into subject-predicate-object triples, then selectively modifying these triples to disrupt spurious correlations. By reconstructing the text from these adjusted triples, CoBA generates counterbias data that mitigates spurious patterns. Through extensive experiments, we demonstrate that CoBA not only improves downstream task performance, but also effectively reduces biases and strengthens out-of-distribution resilience, offering a versatile and robust solution to the challenges posed by spurious correlations.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 55 of its 84 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
55 of 84 references.
References · 55
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
38 more
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
- 2018Recognition in Terra Incognitacited by 658
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
- 2021Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Modelscited by 222
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
- 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
- 2020Towards Debiasing Sentence Representationscited by 171
- 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 130
- 2018Conditional BERT Contextual Augmentationcited by 107
- 2022The Shapley Value in Machine Learningcited by 98
- 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
- 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 75
- 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
- 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
- 2023Explore Spurious Correlations at the Concept Level in Language Models for Text Classificationcited by 48
- 2020Contrastive Triple Extraction with Generative Transformercited by 44
- 2023Prompting Large Language Models for Counterfactual Generation: An Empirical Studycited by 37
- 2023How Re-sampling Helps for Long-Tail Learning?cited by 36
- 2022Are All Spurious Features in Natural Language Alike? An Analysis through a Causal Lenscited by 28
- 2023Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventionscited by 28
- 2021Influence Tuning: Demoting Spurious Correlations via Instance Attribution and Instance-Driven Updatescited by 27
- 2023CREST: A Joint Framework for Rationalization and Counterfactual Text Generationcited by 24
- 2024A Survey on Natural Language Counterfactual Generationcited by 21
- 2021Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extractioncited by 17
- 2023CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibrationcited by 17
- 2024Effects of diversity incentives on sample diversity and downstream model performance in LLM-based text augmentationcited by 17
- 2023Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysiscited by 11
- 2022Selection Bias Induced Spurious Correlations in Large Language Modelscited by 9
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.