Improving Multi-turn Dialogue Modelling with Utterance ReWriter
Not on the map. Why?
Abstract (arXiv)
Recent research has made impressive progress in single-turn dialogue modelling. In the multi-turn setting, however, current models are still far from satisfactory. One major challenge is the frequently occurred coreference and information omission in our daily conversation, making it hard for machines to understand the real intention. In this paper, we propose rewriting the human utterance as a pre-process to help multi-turn dialgoue modelling. Each utterance is first rewritten to recover all coreferred and omitted information. The next processing steps are then performed based on the rewritten utterance. To properly train the utterance rewriter, we collect a new dataset with human annotations and introduce a Transformer-based utterance rewriting architecture using the pointer network. We show the proposed architecture achieves remarkably good performance on the utterance rewriting task. The trained utterance rewriter can be easily integrated into online chatbots and brings general improvement over different domains.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 13; 2024: 6; 2025: 9; 2026: 6.
57 papers.
Sort:
By area:
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 89
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
- 2024Can Large Language Models Understand Context?cited by 26
- 2025Adaptive Social Learning via Mode Policy Optimization for Language Agentscited by 15
- 2026Benchmarking LLM Tool-Use in the Wildcited by 15
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
- 2021CREAD: Combined Resolution of Ellipses and Anaphora in Dialoguescited by 13
- 2022Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text Generationcited by 9
- 2022UniDU: Towards A Unified Generative Dialogue Understanding Frameworkcited by 9
- 2023A Survey on Zero Pronoun Translationcited by 9
- 2023Mining Clues from Incomplete Utterance: A Query-enhanced Network for Incomplete Utterance Rewritingcited by 9
38 more
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
- 2021Conversational Semantic Role Labelingcited by 8
- 2023Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understandingcited by 8
- 2021Towards Standard Criteria for human evaluation of Chatbots: A Surveycited by 6
- 2022McQueen: a Benchmark for Multimodal Conversational Query Rewritecited by 6
- 2021Conversational Query Rewriting with Self-supervised Learningcited by 5
- 2022Hierarchical Context Tagging for Utterance Rewritingcited by 4
- 2022Improving Bot Response Contradiction Detection via Utterance Rewritingcited by 4
- 2025C3-Bench: The Things Real Disturbing LLM based Agent in Multi-Taskingcited by 4
- 2022Self-Aware Feedback-Based Self-Learning in Large-Scale Conversational AIcited by 3
- 2022A General Contextualized Rewriting Framework for Text Summarizationcited by 3
- 2022PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstandingcited by 3
- 2023KG-ECO: Knowledge Graph Enhanced Entity Correction for Query Rewritingcited by 3
- 2021A Joint Model for Dropped Pronoun Recovery and Conversational Discourse Parsing in Chinese Conversational Speechcited by 2
- 2022Self-Attention for Incomplete Utterance Rewritingcited by 2
- 2022What Did You Say? Task-Oriented Dialog Datasets Are Not Conversational!?cited by 2
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selectioncited by 2
- 2023Incomplete Utterance Rewriting as Sequential Greedy Taggingcited by 2
- 2023Multi-Granularity Information Interaction Framework for Incomplete Utterance Rewritingcited by 2
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Modelscited by 2
- 2022Utterance Rewriting with Contrastive Learning in Multi-turn Dialoguecited by 1
- 2023Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehensioncited by 1
- 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsingcited by 1
- 2023On the Robustness of Question Rewriting Systems to Questions of Varying Hardnesscited by 1
- 2025Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentationcited by 1
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistantscited by 1
- 2026MedAidDialog: A Multilingual Multi-Turn Medical Dialogue Dataset for Accessible Healthcarecited by 1
- 2026Evaluating Temporal Consistency in Multi-Turn Language Modelscited by 1
- 2021Coreference Augmentation for Multi-Domain Task-Oriented Dialogue State Trackingcited by 0
- 2021Learning to Ask Conversational Questions by Optimizing Levenshtein Distancecited by 0
- 2021Action based Network for Conversation Question Reformulationcited by 0
- 2022Zero-shot Cross-lingual Conversational Semantic Role Labelingcited by 0
- 2022Meeting Decision Tracker: Making Meeting Minutes with De-Contextualized Utterancescited by 0
- 2023Channel-aware Decoupling Network for Multi-turn Dialogue Comprehensioncited by 0
- 2023Friend-training: Learning from Models of Different but Related Taskscited by 0
- 20235IDER: Unified Query Rewriting for Steering, Intent Carryover, Disfluencies, Entity Carryover and Repaircited by 0
- 2024Making a Long Story Short in Conversation Modelingcited by 0
- 2024CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewritecited by 0
50 most cited of 57 All 57 (JSON)
- 2026VeriChat: An Agentic Conversational AI Assistant for Hardware Security Verification2 Jul 2026
- 2026Evaluating Temporal Consistency in Multi-Turn Language Models24 Apr 2026
- 2026MedAidDialog: A Multilingual Multi-Turn Medical Dialogue Dataset for Accessible Healthcare25 Mar 2026
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning27 Feb 2026
- 2026Benchmarking LLM Tool-Use in the Wild13 Feb 2026
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistants6 Jan 2026
- 2025Freeze and Reveal: Exposing Modality Bias in Vision-Language Models10 Aug 2025
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifesto8 Jun 2025
- 2025C3-Bench: The Things Real Disturbing LLM based Agent in Multi-Tasking24 May 2025
- 2025Adaptive Social Learning via Mode Policy Optimization for Language Agents4 May 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
38 more
- 2025Two-stage Incomplete Utterance Rewriting on Editing Operation20 Mar 2025
- 2025Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation20 Mar 2025
- 2025RSMLP: A light Sampled MLP Structure for Incomplete Utterance Rewrite18 Feb 2025
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024In-Context Learning with Reinforcement Learning for Incomplete Utterance Rewriting23 Aug 2024
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphs3 Jun 2024
- 2024CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewrite18 Mar 2024
- 2024Can Large Language Models Understand Context?1 Feb 2024
- 2024Making a Long Story Short in Conversation Modeling31 Jan 2024
- 2023Multi-Granularity Information Interaction Framework for Incomplete Utterance Rewriting19 Dec 2023
- 2023On the Robustness of Question Rewriting Systems to Questions of Varying Hardness12 Nov 2023
- 2023Incomplete Utterance Rewriting as Sequential Greedy Tagging8 Jul 2023
- 2023Mining Clues from Incomplete Utterance: A Query-enhanced Network for Incomplete Utterance Rewriting3 Jul 2023
- 20235IDER: Unified Query Rewriting for Steering, Intent Carryover, Disfluencies, Entity Carryover and Repair2 Jun 2023
- 2023Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understanding23 May 2023
- 2023A Survey on Zero Pronoun Translation17 May 2023
- 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsing11 May 2023
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human16 Apr 2023
- 2023Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehension27 Feb 2023
- 2023KG-ECO: Knowledge Graph Enhanced Entity Correction for Query Rewriting21 Feb 2023
- 2023Friend-training: Learning from Models of Different but Related Tasks31 Jan 2023
- 2023Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension10 Jan 2023
- 2022IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection1 Dec 2022
- 2022McQueen: a Benchmark for Multimodal Conversational Query Rewrite23 Oct 2022
- 2022PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding22 Oct 2022
- 2022Meeting Decision Tracker: Making Meeting Minutes with De-Contextualized Utterances20 Oct 2022
- 2022Improving Bot Response Contradiction Detection via Utterance Rewriting25 Jul 2022
- 2022A General Contextualized Rewriting Framework for Text Summarization13 Jul 2022
- 2022Hierarchical Context Tagging for Utterance Rewriting22 Jun 2022
- 2022Self-Aware Feedback-Based Self-Learning in Large-Scale Conversational AI29 Apr 2022
- 2022Zero-shot Cross-lingual Conversational Semantic Role Labeling11 Apr 2022
- 2022UniDU: Towards A Unified Generative Dialogue Understanding Framework10 Apr 2022
- 2022Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text Generation8 Apr 2022
- 2022Utterance Rewriting with Contrastive Learning in Multi-turn Dialogue22 Mar 2022
- 2022What Did You Say? Task-Oriented Dialog Datasets Are Not Conversational!?7 Mar 2022
- 2022Self-Attention for Incomplete Utterance Rewriting24 Feb 2022
- 2021Action based Network for Conversation Question Reformulation29 Nov 2021
- 2021Learning to Ask Conversational Questions by Optimizing Levenshtein Distance30 Jun 2021
50 newest of 57 All 57 (JSON)
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 89
- 2024Can Large Language Models Understand Context?cited by 26
- 2026Benchmarking LLM Tool-Use in the Wildcited by 15
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
- 2021CREAD: Combined Resolution of Ellipses and Anaphora in Dialoguescited by 13
- 2022Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text Generationcited by 9
- 2022UniDU: Towards A Unified Generative Dialogue Understanding Frameworkcited by 9
- 2023A Survey on Zero Pronoun Translationcited by 9
- 2023Mining Clues from Incomplete Utterance: A Query-enhanced Network for Incomplete Utterance Rewritingcited by 9
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversationscited by 9
- 2021Conversational Semantic Role Labelingcited by 8
12 most cited of 50 All 50 (JSON)
- 2026Evaluating Temporal Consistency in Multi-Turn Language Models24 Apr 2026
- 2026MedAidDialog: A Multilingual Multi-Turn Medical Dialogue Dataset for Accessible Healthcare25 Mar 2026
- 2026Benchmarking LLM Tool-Use in the Wild13 Feb 2026
- 2026HiMeS: Hippocampus-inspired Memory System for Personalized AI Assistants6 Jan 2026
- 2025C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations30 Jul 2025
- 2025Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifesto8 Jun 2025
- 2025Two-stage Incomplete Utterance Rewriting on Editing Operation20 Mar 2025
- 2025Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation20 Mar 2025
- 2025RSMLP: A light Sampled MLP Structure for Incomplete Utterance Rewrite18 Feb 2025
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024In-Context Learning with Reinforcement Learning for Incomplete Utterance Rewriting23 Aug 2024
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphs3 Jun 2024
12 newest of 50 All 50 (JSON)