mlsanityData to 7 Oct 2026

Vietnamese Capitalization and Punctuation Recovery Models

arXiv 2207.01312 ↗First posted 4 Jul 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Despite the rise of recent performant methods in Automatic Speech Recognition (ASR), such methods do not ensure proper casing and punctuation for their outputs. This problem has a significant impact on the comprehension of both Natural Language Processing (NLP) algorithms and human to process. Capitalization and punctuation restoration is imperative in pre-processing pipelines for raw textual inputs. For low resource languages like Vietnamese, public datasets for this task are scarce. In this paper, we contribute a public dataset for capitalization and punctuation recovery for Vietnamese; and propose a joint model for both tasks named JointCapPunc. Experimental results on the Vietnamese dataset show the effectiveness of our joint model compare to single model and previous joint learning model. We publicly release our dataset and the implementation of our model at https://github.com/anhtunguyen98/JointCapPunc

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 4 Jul 2022.

Builds on

14 of 32 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  8. 2020Improving Sequence Tagging for Vietnamese Text Using Transformer-based Neural Modelscited by 22
  9. 2018Punctuation Prediction Model for Conversational Speechcited by 20
  10. 2020Robust Prediction of Punctuation and Truecasing for Medical ASRcited by 16
  11. 2019Fast and Accurate Capitalization and Punctuation for Automatic Speech Recognition Using Transformer and Chunk Mergingcited by 14
  12. 2020Improving Vietnamese Named Entity Recognition from Speech Using Word Capitalization and Punctuation Recovery Modelscited by 10
2 more
  1. 2017Joint Learning of Correlated Sequence Labelling Tasks Using Bidirectional Recurrent Neural Networkscited by 6
  2. 2020Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviewscited by 6

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Efficient Ensemble for Multimodal Punctuation Restoration using Time-Delay Neural Networkcited by 1