End-to-end Conversation Modeling Track in DSTC6
Not on the map. Why?
Abstract (arXiv)
End-to-end training of neural networks is a promising approach to automatic construction of dialog systems using a human-to-human dialog corpus. Recently, Vinyals et al. tested neural conversation models using OpenSubtitles. Lowe et al. released the Ubuntu Dialogue Corpus for researching unstructured multi-turn dialogue systems. Furthermore, the approach has been extended to accomplish task oriented dialogs to provide information properly with natural conversation. For example, Ghazvininejad et al. proposed a knowledge grounded neural conversation model [3], where the research is aiming at combining conversational dialogs with task-oriented knowledge using unstructured data such as Twitter data for conversation and Foursquare data for external knowledge.However, the task is still limited to a restaurant information service, and has not yet been tested with a wide variety of dialog tasks. In addition, it is still unclear how to create intelligent dialog systems that can respond like a human agent. In consideration of these problems, we proposed a challenge track to the 6th dialog system technology challenges (DSTC6) using human-to-human dialog data to mimic human dialog behaviors. The focus of the challenge track is to train end-to-end conversation models from human-to-human conversation and accomplish end-to-end dialog tasks in various situations assuming a customer service, in which a system plays a role of human agent and generates natural and informative sentences in response to user's questions or comments given dialog context.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 2; 2023: 4; 2024: 2.
12 papers.
- 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Modelscited by 100
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2021Automatic Evaluation and Moderation of Open-domain Dialogue Systemscited by 28
- 2021MDD-Eval: Self-Training on Augmented Data for Multi-Domain Dialogue Evaluationcited by 13
- 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluationcited by 10
- 2023RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialoguecited by 7
- 2021Modeling Performance in Open-Domain Dialogue with PARADISEcited by 5
- 2022MME-CRS: Multi-Metric Evaluation Based on Correlation Re-Scaling for Evaluating Open-Domain Dialoguecited by 5
- 2023Improving Open-Domain Dialogue Evaluation with a Causal Inference Modelcited by 4
- 2023Psychological Metrics for Dialog System Evaluationcited by 4
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmarkcited by 3
- 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation4 Jul 2024
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark17 Jun 2024
- 2023RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue15 Sep 2023
- 2023Psychological Metrics for Dialog System Evaluation24 May 2023
- 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Models23 May 2023
- 2023Improving Open-Domain Dialogue Evaluation with a Causal Inference Model31 Jan 2023
- 2022MME-CRS: Multi-Metric Evaluation Based on Correlation Re-Scaling for Evaluating Open-Domain Dialogue19 Jun 2022
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning25 May 2022
- 2021MDD-Eval: Self-Training on Augmented Data for Multi-Domain Dialogue Evaluation14 Dec 2021
- 2021Automatic Evaluation and Moderation of Open-domain Dialogue Systems3 Nov 2021
- 2021Modeling Performance in Open-Domain Dialogue with PARADISE21 Oct 2021
- 2021A Comprehensive Assessment of Dialog Evaluation Metrics7 Jun 2021