Building a Swedish Open-Domain Conversational Language Model
Not on the map. Why?
Abstract (arXiv)
We present on-going work of evaluating the, to our knowledge, first large generative language model trained to converse in Swedish, using data from the online discussion forum Flashback. We conduct a human evaluation pilot study that indicates the model is often able to respond to conversations in both a human-like and informative manner, on a diverse set of topics. While data from online forums can be useful to build conversational systems, we reflect on the negative consequences that incautious application might have, and the need for taking active measures to safeguard against them.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 12 Apr 2021.
Builds on
18 of 27 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2020Recipes for building an open-domain chatbotcited by 593
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
6 more
- 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
- 2015A Neural Conversational Modelcited by 196
- 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
- 2015Neural Responding Machine for Short-Text Conversationcited by 124
- 2015A Neural Network Approach to Context-Sensitive Generation of Conversational Responsescited by 98
- 2020Is Machine Learning Speaking my Language? A Critical Look at the NLP-Pipeline Across 8 Human Languagescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.