Using Synthetic Data for Conversational Response Generation in Low-resource Settings
Not on the map. Why?
Abstract (arXiv)
Response generation is a task in natural language processing (NLP) where a model is trained to respond to human statements. Conversational response generators take this one step further with the ability to respond within the context of previous responses. While there are existing techniques for training such models, they all require an abundance of conversational data which are not always available for low-resource languages. In this research, we make three contributions. First, we released the first Filipino conversational dataset collected from a popular Philippine online forum, which we named the PEx Conversations Dataset. Second, we introduce a data augmentation (DA) methodology for Filipino data by employing a Tagalog RoBERTa model to increase the size of the existing corpora. Lastly, we published the first Filipino conversational response generator capable of generating responses related to the previous 3 responses. With the supplementary synthetic data, we were able to improve the performance of the response generator by up to 12.2% in BERTScore, 10.7% in perplexity, and 11.7% in content word usage as compared to training with zero synthetic data.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 6 Apr 2022.
Builds on
15 of 19 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
- 2018Conditional BERT Contextual Augmentationcited by 107
- 2020Training Question Answering Models From Synthetic Datacited by 95
- 2020An Analysis of Simple Data Augmentation for Named Entity Recognitioncited by 75
- 2021Improving Large-scale Language Models and Resources for Filipinocited by 19
3 more
Built on by
Citing papers per year: 2023: 2.
2 papers.