mlsanityData to 7 Oct 2026

Leveraging Semantic Representations Combined with Contextual Word Representations for Recognizing Textual Entailment in Vietnamese

arXiv 2301.00422 ↗First posted 1 Jan 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

RTE is a significant problem and is a reasonably active research community. The proposed research works on the approach to this problem are pretty diverse with many different directions. For Vietnamese, the RTE problem is moderately new, but this problem plays a vital role in natural language understanding systems. Currently, methods to solve this problem based on contextual word representation learning models have given outstanding results. However, Vietnamese is a semantically rich language. Therefore, in this paper, we want to present an experiment combining semantic word representation through the SRL task with context representation of BERT relative models for the RTE problem. The experimental results give conclusions about the influence and role of semantic representation on Vietnamese in understanding natural language. The experimental results show that the semantic-aware contextual representation model has about 1% higher performance than the model that does not incorporate semantic representation. In addition, the effects on the data domain in Vietnamese are also higher than those in English. This result also shows the positive influence of SRL on RTE problem in Vietnamese.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 1 Jan 2023.

Builds on

11 of 18 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  5. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  6. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  7. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 148
  8. 2019Semantics-aware BERT for Language Understandingcited by 111
  9. 2020Rethinking embedding coupling in pre-trained language modelscited by 103
  10. 2020Cross-lingual Semantic Role Labeling with Model Transfercited by 11
  11. 2021Improving Portuguese Semantic Role Labeling with Transformers and Transfer Learningcited by 2

Built on by

Not cited yet.