mlsanityData to 14 Oct 2026

Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering

arXiv 1904.06652 ↗First posted 14 Apr 2019cs.CL cs.IRcited by 21

Not on the map. Why?

Abstract (arXiv)

Recently, a simple combination of passage retrieval using off-the-shelf IR techniques and a BERT reader was found to be very effective for question answering directly on Wikipedia, yielding a large improvement over the previous state of the art on a standard benchmark dataset. In this paper, we present a data augmentation technique using distant supervision that exploits positive as well as negative examples. We apply a stage-wise approach to fine tuning BERT on multiple datasets, starting with data that is "furthest" from the test data and ending with the "closest". Experimental results show large gains in effectiveness over previous approaches on English QA datasets, and we establish new baselines on two recent Chinese QA datasets.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 6; 2022: 7; 2023: 3; 2024: 1; 2025: 4.

21 papers.

Sort:

  1. 2021A Survey of Data Augmentation Approaches for NLPcited by 409
  2. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  3. 2021MDPFuzz: Testing Models Solving Markov Decision Processescited by 12
  4. 2022Prompt-Learning for Short Text Classificationcited by 11
  5. 2021Studying Catastrophic Forgetting in Neural Ranking Modelscited by 9
  6. 2021Revisiting Contextual Toxicity Detection in Conversationscited by 8
  7. 2022Improved Text Classification via Test-Time Augmentationcited by 7
  8. 2022Interactive Question Answering Systems: Literature Reviewcited by 7
  9. 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generationcited by 7
  10. 2024Exploration of Masked and Causal Language Modelling for Text Generationcited by 7
  11. 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbationscited by 5
  12. 2022Data Augmentation for Biomedical Factoid Question Answeringcited by 5
9 more
  1. 2022Continual Learning of Long Topic Sequences in Neural Information Retrievalcited by 4
  2. 2021Data Augmentation Methods for Anaphoric Zero Pronounscited by 3
  3. 2025Filtering with Confidence: When Data Augmentation Meets Conformal Predictioncited by 3
  4. 2022PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GANcited by 2
  5. 2025Sentiment Analysis of Movie Reviews Using BERTcited by 2
  6. 2025QUARTZ : QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarizationcited by 2
  7. 2025Fine-tuning BERT with Bidirectional LSTM for Fine-grained Movie Reviews Sentiment Analysiscited by 1
  8. 2023UATTA-EB: Uncertainty-Aware Test-Time Augmented Ensemble of BERTs for Classifying Common Mental Illnesses on Social Media Postscited by 0
  9. 2023Abstractive Summarization as Augmentation for Document-Level Event Detectioncited by 0