# Constructive and Toxic Speech Detection for Open-domain Social Media Comments in Vietnamese

arXiv: https://arxiv.org/abs/2103.10069 · HTML: https://mlsanity.com/paper/2103.10069/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 22 references that are in the map.
- First posted on arXiv 18 Mar 2021.

## Builds on (most cited first, 12 of 12)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [fairseq: A Fast, Extensible Toolkit for Sequence Modeling](https://mlsanity.com/paper/1904.01038/) (2019)
- [Learning Word Vectors for 157 Languages](https://mlsanity.com/paper/1802.06893/) (2018)
- [PhoBERT: Pre-trained language models for Vietnamese](https://mlsanity.com/paper/2003.00744/) (2020)
- [VnCoreNLP: A Vietnamese Natural Language Processing Toolkit](https://mlsanity.com/paper/1801.01331/) (2018)
- [A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese](https://mlsanity.com/paper/2010.01891/) (2020)
- [Emotion Recognition for Vietnamese Social Media Text](https://mlsanity.com/paper/1911.09339/) (2019)
- [HSD Shared Task in VLSP Campaign 2019:Hate Speech Detection for Social Good](https://mlsanity.com/paper/2007.06493/) (2020)
- [Classifying Constructive Comments](https://mlsanity.com/paper/2004.05476/) (2020)
- [Hate Speech Detection on Vietnamese Social Media Text using the Bi-GRU-LSTM-CNN Model](https://mlsanity.com/paper/1911.03644/) (2019)
- [BANANA at WNUT-2020 Task 2: Identifying COVID-19 Information on Twitter by Combining Deep Learning and Transfer Learning Models](https://mlsanity.com/paper/2009.02671/) (2020)

## Built on by (most cited first, 17 of 17)

- [ViHOS: Hate Speech Spans Detection for Vietnamese](https://mlsanity.com/paper/2301.10186/) (2023)
- [SA2SL: From Aspect-Based Sentiment Analysis to Social Listening System for Business Intelligence](https://mlsanity.com/paper/2105.15079/) (2021)
- [Cyberbullying Detection for Low-resource Languages and Dialects: Review of the State of the Art](https://mlsanity.com/paper/2308.15745/) (2023)
- [SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese](https://mlsanity.com/paper/2209.10482/) (2022)
- [Monolingual versus Multilingual BERTology for Vietnamese Extractive Multi-Document Summarization](https://mlsanity.com/paper/2108.13741/) (2021)
- [Crossing Linguistic Horizons: Finetuning and Comprehensive Evaluation of Vietnamese Large Language Models](https://mlsanity.com/paper/2403.02715/) (2024)
- [Vietnamese Complaint Detection on E-Commerce Websites](https://mlsanity.com/paper/2104.11969/) (2021)
- [ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer Model](https://mlsanity.com/paper/2405.14141/) (2024)
- [SEA-BED: How Do Embedding Models Represent Southeast Asian Languages?](https://mlsanity.com/paper/2508.12243/) (2025)
- [UIT-E10dot3 at SemEval-2021 Task 5: Toxic Spans Detection with Named Entity Recognition and Question-Answering Approaches](https://mlsanity.com/paper/2104.07376/) (2021)
- [Span Detection for Aspect-Based Sentiment Analysis in Vietnamese](https://mlsanity.com/paper/2110.07833/) (2021)
- [ViCGCN: Graph Convolutional Network with Contextualized Language Models for Social Media Mining in Vietnamese](https://mlsanity.com/paper/2309.02902/) (2023)
- [Abusive Span Detection for Vietnamese Narrative Texts](https://mlsanity.com/paper/2312.07831/) (2023)
- [ViTHSD: Exploiting Hatred by Targets for Hate Speech Detection on Vietnamese Social Media Texts](https://mlsanity.com/paper/2404.19252/) (2024)
- [ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterances](https://mlsanity.com/paper/2506.00636/) (2025)
- [NEU-ESC: A Comprehensive Vietnamese dataset for Educational Sentiment analysis and topic Classification toward multitask learning](https://mlsanity.com/paper/2506.23524/) (2025)
- [ViCLSR: A Supervised Contrastive Learning Framework with Natural Language Inference for Natural Language Understanding Tasks](https://mlsanity.com/paper/2603.21084/) (2026)

## Abstract (arXiv)

The rise of social media has led to the increasing of comments on online forums. However, there still exists invalid comments which are not informative for users. Moreover, those comments are also quite toxic and harmful to people. In this paper, we create a dataset for constructive and toxic speech detection, named UIT-ViCTSD (Vietnamese Constructive and Toxic Speech Detection dataset) with 10,000 human-annotated comments. For these tasks, we propose a system for constructive and toxic speech detection with the state-of-the-art transfer learning model in Vietnamese NLP as PhoBERT. With this system, we obtain F1-scores of 78.59% and 59.40% for classifying constructive and toxic comments, respectively. Besides, we implement various baseline models as traditional Machine Learning and Deep Neural Network-Based models to evaluate the dataset. With the results, we can solve several tasks on the online discussions and develop the framework for identifying constructiveness and toxicity of Vietnamese social media comments automatically.