mlsanityData to 7 Oct 2026

Deep Understanding based Multi-Document Machine Reading Comprehension

arXiv 2204.03494 ↗First posted 25 Feb 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore following two kinds of understandings. First, to understand the semantic meaning of words in the input question and documents from the perspective of each other. Second, to understand the supporting cues for a correct answer from the perspective of intra-document and inter-documents. Ignoring these two kinds of important understandings would make the models oversee some important information that may be helpful for inding correct answers. To overcome this deiciency, we propose a deep understanding based model for multi-document machine reading comprehension. It has three cascaded deep understanding modules which are designed to understand the accurate semantic meaning of words, the interactions between the input question and documents, and the supporting cues for the correct answer. We evaluate our model on two large scale benchmark datasets, namely TriviaQA Web and DuReader. Extensive experiments show that our model achieves state-of-the-art results on both datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 25 Feb 2022.

Builds on

40 of 57 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2018Deep contextualized word representationscited by 2,285
  8. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  10. 2015Pointer Networkscited by 882
  11. 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
  12. 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
28 more
  1. 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
  2. 2017Simple and Effective Multi-Paragraph Reading Comprehensioncited by 120
  3. 2019Semantics-aware BERT for Language Understandingcited by 111
  4. 2017DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applicationscited by 110
  5. 2020Retrospective Reader for Machine Reading Comprehensioncited by 86
  6. 2020TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linkingcited by 72
  7. 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
  8. 2016Machine Comprehension Using Match-LSTM and Answer Pointercited by 47
  9. 2016Attention-over-Attention Neural Networks for Reading Comprehensioncited by 31
  10. 2018Read + Verify: Machine Reading Comprehension with Unanswerable Questionscited by 31
  11. 2020Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehensioncited by 29
  12. 2018Multi-granularity hierarchical attention fusion networks for reading comprehension and question answeringcited by 28
  13. 2017Stochastic Answer Networks for Machine Reading Comprehensioncited by 22
  14. 2021Self-Supervised Test-Time Learning for Reading Comprehensioncited by 22
  15. 2018Improving Machine Reading Comprehension with General Reading Strategiescited by 20
  16. 2020Bridging Information-Seeking Human Gaze and Machine Reading Comprehensioncited by 20
  17. 2018Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verificationcited by 17
  18. 2020Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehensioncited by 17
  19. 2019Multi-style Generative Reading Comprehensioncited by 14
  20. 2021ReadTwice: Reading Very Large Documents with Memoriescited by 14
  21. 2019Discourse-Aware Semantic Self-Attention for Narrative Reading Comprehensioncited by 12
  22. 2018A Deep Cascade Model for Multi-Document Reading Comprehensioncited by 11
  23. 2018Multi-task Learning with Sample Re-weighting for Machine Reading Comprehensioncited by 8
  24. 2018Joint Training of Candidate Extraction and Answer Selection for Reading Comprehensioncited by 4
  25. 2020MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehensioncited by 3
  26. 2020Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehensioncited by 3
  27. 2017Smarnet: Teaching Machines to Read and Comprehend Like Humancited by 2
  28. 2017Fast Reading Comprehension with ConvNetscited by 1

Built on by

Not cited yet.