mlsanityData to 7 Oct 2026

Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasets

arXiv 2408.02114 ↗First posted 4 Aug 2024cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer researchers a comprehensive overview of the current landscape in multi-choice MRC. The analysis delves into 30 existing cloze-style and multiple-choice MRC benchmark datasets, employing a refined classification method based on attributes such as corpus style, domain, complexity, context style, question style, and answer style. This classification system enhances our understanding of each dataset's diverse attributes and categorizes them based on their complexity. Furthermore, the paper categorizes recent methodologies into Fine-tuned and Prompt-tuned methods. Fine-tuned methods involve adapting pre-trained language models (PLMs) to a specific task through retraining on domain-specific datasets, while prompt-tuned methods use prompts to guide PLM response generation, presenting potential applications in zero-shot or few-shot learning scenarios. By contributing to ongoing discussions, inspiring future research directions, and fostering innovations, this paper aims to propel multi-choice MRC towards new frontiers of achievement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 78 references that are in the map. First posted on arXiv 4 Aug 2024.

Builds on

63 of 78 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  11. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  12. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
38 more
  1. 2020Longformer: The Long-Document Transformercited by 3,362
  2. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  6. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  7. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  8. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  9. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  10. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  11. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  12. 2017Crowdsourcing Multiple Choice Science Questionscited by 742
  13. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  14. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  15. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
  16. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  17. 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
  18. 2019Knowledge Enhanced Contextual Word Representationscited by 294
  19. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  20. 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
  21. 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
  22. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
  23. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
  24. 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
  25. 2019DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehensioncited by 156
  26. 2015The Goldilocks Principle: Reading Children's Books with Explicit Memory Representationscited by 108
  27. 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
  28. 2020RealFormer: Transformer Likes Residual Attentioncited by 62
  29. 2017Quasar: Datasets for Question Answering by Search and Readingcited by 50
  30. 2021ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 45
  31. 2020A Survey on Machine Reading Comprehension Systemscited by 41
  32. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  33. 2020BIOMRC: A Dataset for Biomedical Machine Reading Comprehensioncited by 35
  34. 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
  35. 2018MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledgecited by 30
  36. 2022XPrompt: Exploring the Extreme of Prompt Tuningcited by 30
  37. 2017Large-scale Cloze Test Dataset Created by Teacherscited by 27
  38. 2021English Machine Reading Comprehension Datasets: A Surveycited by 26

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.