Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasets
Not on the map. Why?
Abstract (arXiv)
This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer researchers a comprehensive overview of the current landscape in multi-choice MRC. The analysis delves into 30 existing cloze-style and multiple-choice MRC benchmark datasets, employing a refined classification method based on attributes such as corpus style, domain, complexity, context style, question style, and answer style. This classification system enhances our understanding of each dataset's diverse attributes and categorizes them based on their complexity. Furthermore, the paper categorizes recent methodologies into Fine-tuned and Prompt-tuned methods. Fine-tuned methods involve adapting pre-trained language models (PLMs) to a specific task through retraining on domain-specific datasets, while prompt-tuned methods use prompts to guide PLM response generation, presenting potential applications in zero-shot or few-shot learning scenarios. By contributing to ongoing discussions, inspiring future research directions, and fostering innovations, this paper aims to propel multi-choice MRC towards new frontiers of achievement.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 78 references that are in the map. First posted on arXiv 4 Aug 2024.
Builds on
63 of 78 references.
References · 63
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
38 more
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
- 2017Crowdsourcing Multiple Choice Science Questionscited by 742
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
- 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
- 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
- 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
- 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
- 2019DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehensioncited by 156
- 2015The Goldilocks Principle: Reading Children's Books with Explicit Memory Representationscited by 108
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2020RealFormer: Transformer Likes Residual Attentioncited by 62
- 2017Quasar: Datasets for Question Answering by Search and Readingcited by 50
- 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
- 2020A Survey on Machine Reading Comprehension Systemscited by 41
- 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
- 2020BIOMRC: A Dataset for Biomedical Machine Reading Comprehensioncited by 35
- 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
- 2018MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledgecited by 30
- 2022XPrompt: Exploring the Extreme of Prompt Tuningcited by 30
- 2017Large-scale Cloze Test Dataset Created by Teacherscited by 27
- 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.