A Survey on Machine Reading Comprehension Systems
Not on the map. Why?
Abstract (arXiv)
Machine reading comprehension is a challenging task and hot topic in natural language processing. Its goal is to develop systems to answer the questions regarding a given context. In this paper, we present a comprehensive survey on different aspects of machine reading comprehension systems, including their approaches, structures, input/outputs, and research novelties. We illustrate the recent trends in this field based on 241 reviewed papers from 2016 to 2020. Our investigations demonstrate that the focus of research has changed in recent years from answer extraction to answer generation, from single to multi-document reading comprehension, and from learning from scratch to using pre-trained embeddings. We also discuss the popular datasets and the evaluation metrics in this field. The paper ends with investigating the most cited papers and their contributions.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 9; 2024: 12; 2025: 3.
41 papers.
Sort:
By area:
- 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUcited by 53
- 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
- 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
- 2023Rationalization for Explainable NLP: A Surveycited by 22
- 2021Multi-Row, Multi-Span Distant Supervision For Table+Text Questioncited by 12
- 2024LLMs' Reading Comprehension Is Affected by Parametric Knowledge and Struggles with Hypothetical Statementscited by 12
- 2024Improving Health Question Answering with Reliable and Time-Aware Evidence Retrievalcited by 12
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verificationcited by 10
- 2024Temporal Blind Spots in Large Language Modelscited by 7
- 2024Question Difficulty Ranking for Multiple-Choice Reading Comprehensioncited by 7
- 2022APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoningcited by 5
- 2023MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading Comprehensioncited by 5
29 more
- 2021ComQA:Compositional Question Answering via Hierarchical Graph Neural Networkscited by 4
- 2022DTW at Qur'an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domaincited by 4
- 2022A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehensioncited by 4
- 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answeringcited by 4
- 2022BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Taskcited by 3
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Modelscited by 3
- 2024Telco-DPR: A Hybrid Dataset for Evaluating Retrieval Models of 3GPP Technical Specificationscited by 3
- 2021Literature review on vulnerability detection using NLP technologycited by 2
- 2021Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systemscited by 2
- 2021NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformercited by 1
- 2021Building a Question and Answer System for News Domaincited by 1
- 2021Zero-Shot Estimation of Base Models' Weights in Ensemble of Machine Reading Comprehension Systems for Robust Generalizationcited by 1
- 2021CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understandingcited by 1
- 2022Lite Unified Modeling for Discriminative Reading Comprehensioncited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metricscited by 1
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approachescited by 1
- 2023When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dustcited by 1
- 2023QASnowball: An Iterative Bootstrapping Framework for High-Quality Question-Answering Data Generationcited by 1
- 2023Multi-grained Evidence Inference for Multi-choice Reading Comprehensioncited by 1
- 2024An Information-Theoretic Approach to Analyze NLP Classification Taskscited by 1
- 2024VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehensioncited by 1
- 2024Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehensioncited by 1
- 2025FactGuard: Leveraging Multi-Agent Systems to Generate Answerable and Unanswerable Questions for Enhanced Long-Context LLM Extractioncited by 1
- 2025MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answeringcited by 1
- 2023Secret-Keeping in Question Answeringcited by 0
- 2023KoBigBird-large: Transformation of Transformer for Korean Language Understandingcited by 0
- 2024Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasetscited by 0
- 2024RoBIn: A Transformer-Based Model For Risk Of Bias Inference With Machine Reading Comprehensioncited by 0
- 2025Charting the Future of Scholarly Knowledge with AI: A Community Perspectivecited by 0
- 2025Charting the Future of Scholarly Knowledge with AI: A Community Perspective27 Aug 2025
- 2025MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answering15 Aug 2025
- 2025FactGuard: Leveraging Multi-Agent Systems to Generate Answerable and Unanswerable Questions for Enhanced Long-Context LLM Extraction8 Apr 2025
- 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answering5 Dec 2024
- 2024RoBIn: A Transformer-Based Model For Risk Of Bias Inference With Machine Reading Comprehension28 Oct 2024
- 2024Telco-DPR: A Hybrid Dataset for Evaluating Retrieval Models of 3GPP Technical Specifications15 Oct 2024
- 2024Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasets4 Aug 2024
- 2024Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension29 May 2024
- 2024Question Difficulty Ranking for Multiple-Choice Reading Comprehension16 Apr 2024
- 2024Improving Health Question Answering with Reliable and Time-Aware Evidence Retrieval12 Apr 2024
- 2024LLMs' Reading Comprehension Is Affected by Parametric Knowledge and Struggles with Hypothetical Statements9 Apr 2024
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verification5 Feb 2024
29 more
- 2024VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehension5 Feb 2024
- 2024An Information-Theoretic Approach to Analyze NLP Classification Tasks1 Feb 2024
- 2024Temporal Blind Spots in Large Language Models22 Jan 2024
- 2023MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading Comprehension27 Oct 2023
- 2023Multi-grained Evidence Inference for Multi-choice Reading Comprehension27 Oct 2023
- 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU7 Oct 2023
- 2023Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models22 Sep 2023
- 2023KoBigBird-large: Transformation of Transformer for Korean Language Understanding19 Sep 2023
- 2023QASnowball: An Iterative Bootstrapping Framework for High-Quality Question-Answering Data Generation19 Sep 2023
- 2023When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust12 May 2023
- 2023Secret-Keeping in Question Answering16 Mar 2023
- 2023Rationalization for Explainable NLP: A Survey21 Jan 2023
- 2022APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning19 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Datasets and Metrics8 Dec 2022
- 2022A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension5 Sep 2022
- 2022DTW at Qur'an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain12 May 2022
- 2022Lite Unified Modeling for Discriminative Reading Comprehension26 Mar 2022
- 2022BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task26 Feb 2022
- 2021Multi-Row, Multi-Span Distant Supervision For Table+Text Question14 Dec 2021
- 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collections8 Sep 2021
- 2021CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understanding21 Jul 2021
- 2021Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systems1 Jul 2021
- 2021Zero-Shot Estimation of Base Models' Weights in Ensemble of Machine Reading Comprehension Systems for Robust Generalization30 Jun 2021
- 2021Building a Question and Answer System for News Domain12 May 2021
- 2021NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer8 May 2021
- 2021Literature review on vulnerability detection using NLP technology23 Apr 2021
- 2021English Machine Reading Comprehension Datasets: A Survey25 Jan 2021
- 2021ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks16 Jan 2021
- 2021ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collectionscited by 30
- 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
- 2023Rationalization for Explainable NLP: A Surveycited by 22
- 2021Multi-Row, Multi-Span Distant Supervision For Table+Text Questioncited by 12
- 2024LLMs' Reading Comprehension Is Affected by Parametric Knowledge and Struggles with Hypothetical Statementscited by 12
- 2024Improving Health Question Answering with Reliable and Time-Aware Evidence Retrievalcited by 12
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verificationcited by 10
- 2024Temporal Blind Spots in Large Language Modelscited by 7
- 2024Question Difficulty Ranking for Multiple-Choice Reading Comprehensioncited by 7
- 2023MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading Comprehensioncited by 5
- 2021ComQA:Compositional Question Answering via Hierarchical Graph Neural Networkscited by 4
- 2022DTW at Qur'an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domaincited by 4
12 most cited of 37 All 37 (JSON)
- 2025Charting the Future of Scholarly Knowledge with AI: A Community Perspective27 Aug 2025
- 2025MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answering15 Aug 2025
- 2024RoBIn: A Transformer-Based Model For Risk Of Bias Inference With Machine Reading Comprehension28 Oct 2024
- 2024Telco-DPR: A Hybrid Dataset for Evaluating Retrieval Models of 3GPP Technical Specifications15 Oct 2024
- 2024Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasets4 Aug 2024
- 2024Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension29 May 2024
- 2024Question Difficulty Ranking for Multiple-Choice Reading Comprehension16 Apr 2024
- 2024Improving Health Question Answering with Reliable and Time-Aware Evidence Retrieval12 Apr 2024
- 2024LLMs' Reading Comprehension Is Affected by Parametric Knowledge and Struggles with Hypothetical Statements9 Apr 2024
- 2024Comparing Knowledge Sources for Open-Domain Scientific Claim Verification5 Feb 2024
- 2024VlogQA: Task, Dataset, and Baseline Models for Vietnamese Spoken-Based Machine Reading Comprehension5 Feb 2024
- 2024An Information-Theoretic Approach to Analyze NLP Classification Tasks1 Feb 2024
12 newest of 37 All 37 (JSON)