Clozer: Adaptable Data Augmentation for Cloze-style Reading Comprehension
Not on the map. Why?
Abstract (arXiv)
Task-adaptive pre-training (TAPT) alleviates the lack of labelled data and provides performance lift by adapting unlabelled data to downstream task. Unfortunately, existing adaptations mainly involve deterministic rules that cannot generalize well. Here, we propose Clozer, a sequence-tagging based cloze answer extraction method used in TAPT that is extendable for adaptation on any cloze-style machine reading comprehension (MRC) downstream tasks. We experiment on multiple-choice cloze-style MRC tasks, and show that Clozer performs significantly better compared to the oracle and state-of-the-art in escalating TAPT effectiveness in lifting model performance, and prove that Clozer is able to recognize the gold answers independently of any heuristics.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 30 Mar 2022.
Builds on
17 of 28 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
- 2017Crowdsourcing Multiple Choice Science Questionscited by 742
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2020Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?cited by 127
- 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 108
- 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
- 2016Dynamic Coattention Networks For Question Answeringcited by 49
- 2020Generative Data Augmentation for Commonsense Reasoningcited by 49
- 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
5 more
- 2019Span Selection Pre-training for Question Answeringcited by 36
- 2016Who did What: A Large-Scale Person-Centered Cloze Datasetcited by 24
- 2021A Hybrid Task-Oriented Dialog System with Domain and Task Adaptive Pretrainingcited by 3
- 2021SemEval-2021 Task 4: Reading Comprehension of Abstract Meaningcited by 3
- 2021ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaningcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.