Viola: A Topic Agnostic Generate-and-Rank Dialogue System
Not on the map. Why?
Abstract (arXiv)
We present Viola, an open-domain dialogue system for spoken conversation that uses a topic-agnostic dialogue manager based on a simple generate-and-rank approach. Leveraging recent advances of generative dialogue systems powered by large language models, Viola fetches a batch of response candidates from various neural dialogue models trained with different datasets and knowledge-grounding inputs. Additional responses originating from template-based generators are also considered, depending on the user's input and detected entities. The hand-crafted generators build on a dynamic knowledge graph injected with rich content that is crawled from the web and automatically processed on a daily basis. Viola's response ranker is a fine-tuned polyencoder that chooses the best response given the dialogue history. While dedicated annotations for the polyencoder alone can indirectly steer it away from choosing problematic responses, we add rule-based safety nets to detect neural degeneration and a dedicated classifier to filter out offensive content. We analyze conversations that Viola took part in for the Alexa Prize Socialbot Grand Challenge 4 and discuss the strengths and weaknesses of our approach. Lastly, we suggest future work with a focus on curating conversation data specifcially for socialbots that will contribute towards a more robust data-driven socialbot.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 25 Aug 2021.
Builds on
22 of 35 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2020Recipes for building an open-domain chatbotcited by 593
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
- 2020Recipes for Safety in Open-domain Chatbotscited by 168
- 2017ParlAI: A Dialog Research Software Platformcited by 139
10 more
- 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2021Adaptive Semiparametric Language Modelscited by 83
- 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
- 2018Advancing the State of the Art in Open Domain Dialog Systems through the Alexa Prizecited by 29
- 2020Grounding Conversations with Improvised Dialoguescited by 21
- 2020Policy-Driven Neural Response Generation for Knowledge-Grounded Dialogue Systemscited by 17
- 2018Extending Neural Generative Conversational Model using External Knowledge Sourcescited by 16
- 2020Emora: An Inquisitive Social Chatbot Who Cares For Youcited by 16
- 2020Athena: Constructing Dialogues Dynamically with Discourse Constraintscited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.
- 2024Speechworthy Instruction-tuned Language Models23 Sep 2024
- 2022Mind the Knowledge Gap: A Survey of Knowledge-enhanced Dialogue Systems19 Dec 2022