mlsanityData to 14 Oct 2026

Monolingual versus Multilingual BERTology for Vietnamese Extractive Multi-Document Summarization

arXiv 2108.13741 ↗First posted 31 Aug 2021cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Recent researches have demonstrated that BERT shows potential in a wide range of natural language processing tasks. It is adopted as an encoder for many state-of-the-art automatic summarizing systems, which achieve excellent performance. However, so far, there is not much work done for Vietnamese. In this paper, we showcase how BERT can be implemented for extractive text summarization in Vietnamese on multi-document. We introduce a novel comparison between different multilingual and monolingual BERT models. The experiment results indicate that monolingual models produce promising results compared to other multilingual models and previous text summarizing models for Vietnamese.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 11 of its 37 references that are in the map. First posted on arXiv 31 Aug 2021.

Builds on

11 of 37 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2019Text Summarization with Pretrained Encoderscited by 556
  6. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 149
  7. 2019Discourse-Aware Neural Extractive Text Summarizationcited by 105
  8. 2017Text Summarization Techniques: A Brief Surveycited by 59
  9. 2021Constructive and Toxic Speech Detection for Open-domain Social Media Comments in Vietnamesecited by 17
  10. 2016Multi-document abstractive summarization using ILP based multi-sentence compressioncited by 11
  11. 2020An Experimental Study of Deep Neural Network Models for Vietnamese Multiple-Choice Reading Comprehensioncited by 4

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 1; 2024: 1.

6 papers.

  1. 2022ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generationcited by 37
  2. 2022Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathicited by 16
  3. 2022SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamesecited by 7
  4. 2023ViMMRC 2.0 -- Enhancing Machine Reading Comprehension on Vietnamese Literature Textcited by 5
  5. 2021VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?cited by 1
  6. 2024BERT-VBD: Vietnamese Multi-Document Summarization Frameworkcited by 1