mlsanityData to 7 Oct 2026

Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension

arXiv 2301.00429 ↗First posted 1 Jan 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine Reading Comprehension has become one of the most advanced and popular research topics in the fields of Natural Language Processing in recent years. The classification of answerability questions is a relatively significant sub-task in machine reading comprehension; however, there haven't been many studies. Retro-Reader is one of the studies that has solved this problem effectively. However, the encoders of most traditional machine reading comprehension models in general and Retro-Reader, in particular, have not been able to exploit the contextual semantic information of the context completely. Inspired by SemBERT, we use semantic role labels from the SRL task to add semantics to pre-trained language models such as mBERT, XLM-R, PhoBERT. This experiment was conducted to compare the influence of semantics on the classification of answerability for the Vietnamese machine reading comprehension. Additionally, we hope this experiment will enhance the encoder for the Retro-Reader model's Sketchy Reading Module. The improved Retro-Reader model's encoder with semantics was first applied to the Vietnamese Machine Reading Comprehension task and obtained positive results.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 1 Jan 2023.

Builds on

21 of 36 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  5. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  6. 2018Deep contextualized word representationscited by 2,285
  7. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  8. 2015Teaching Machines to Read and Comprehendcited by 1,039
  9. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  10. 2019Semantics-aware BERT for Language Understandingcited by 111
  11. 2020Retrospective Reader for Machine Reading Comprehensioncited by 86
  12. 2018Read + Verify: Machine Reading Comprehension with Unanswerable Questionscited by 31
9 more
  1. 2020A Vietnamese Dataset for Evaluating Machine Reading Comprehensioncited by 30
  2. 2018Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answeringcited by 24
  3. 2020New Vietnamese Corpus for Machine Reading Comprehension of Health News Articlescited by 23
  4. 2019Dependency or Span, End-to-End Uniform Semantic Role Labelingcited by 22
  5. 2016Text Understanding with the Attention Sum Reader Networkcited by 18
  6. 2022VLSP 2021 - ViMRC Challenge: Vietnamese Machine Reading Comprehensioncited by 7
  7. 2018Stochastic Answer Networks for SQuAD 2.0cited by 5
  8. 2017Vietnamese Semantic Role Labellingcited by 2
  9. 2017Building a Semantic Role Labelling System for Vietnamesecited by 1

Built on by

Not cited yet.