Few-Shot Generative Conversational Query Rewriting
Not on the map. Why?
Abstract (arXiv)
Conversational query rewriting aims to reformulate a concise conversational query to a fully specified, context-independent query that can be effectively handled by existing information retrieval systems. This paper presents a few-shot generative approach to conversational query rewriting. We develop two methods, based on rules and self-supervised learning, to generate weak supervision data using large amounts of ad hoc search sessions, and to fine-tune GPT-2 to rewrite conversational queries. On the TREC Conversational Assistance Track, our weakly supervised GPT-2 rewriter improves the state-of-the-art ranking accuracy by 12%, only using very limited amounts of manual query rewrites. In the zero-shot learning setting, the rewriter still gives a comparable result to previous state-of-the-art systems. Our analyses reveal that GPT-2 effectively picks up the task syntax and learns to capture context dependencies, even for hard cases that involve group references and long-turn dependencies.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 23; 2024: 23; 2025: 12; 2026: 8.
85 papers.
Sort:
By area:
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
- 2023Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewritingcited by 69
- 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2023Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinementcited by 43
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2021MS MARCO: Benchmarking Ranking Models in the Large-Data Regimecited by 28
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
38 more
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024A Survey of Conversational Searchcited by 22
- 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
- 2021A Comparison of Question Rewriting Methods for Conversational Passage Retrievalcited by 16
- 2023Query Performance Prediction: From Ad-hoc to Conversational Searchcited by 16
- 2023Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answeringcited by 15
- 2024Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answerscited by 15
- 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignmentcited by 14
- 2021Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQLcited by 13
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 10
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Searchcited by 10
- 2025Wizard of Shopping: Target-Oriented E-commerce Dialogue Generation with Decision Tree Branchingcited by 10
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidancecited by 10
- 2023Talk the Walk: Synthetic Data Generation for Conversational Music Recommendationcited by 9
- 2023Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understandingcited by 8
- 2024ConvSDG: Session Data Generation for Conversational Searchcited by 8
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Eracited by 8
- 2023Query Understanding in the Age of Large Language Modelscited by 7
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generationcited by 7
- 2022McQueen: a Benchmark for Multimodal Conversational Query Rewritecited by 6
- 2023Beyond Single Items: Exploring User Preferences in Item Sets with the Conversational Playlist Curation Datasetcited by 6
- 2023Generate-then-Retrieve: Intent-Aware FAQ Retrieval in Product Searchcited by 6
- 2024CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Modelscited by 6
- 2021Conversational Query Rewriting with Self-supervised Learningcited by 5
- 2022From Rewriting to Remembering: Common Ground for Conversational QA Modelscited by 5
- 2022SCAI-QReCC Shared Task on Conversational Question Answeringcited by 4
- 2023ZeQR: Zero-shot Query Reformulation for Conversational Searchcited by 4
- 2023Learning to Select the Relevant History Turns in Conversational Question Answeringcited by 4
- 2024History-Aware Conversational Dense Retrievalcited by 4
- 2025Query Understanding in LLM-based Conversational Information Seekingcited by 4
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrievalcited by 4
- 2021High-Quality Diversification for Task-Oriented Dialogue Systemscited by 3
- 2023Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answeringcited by 3
50 most cited of 85 All 85 (JSON)
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026ITER: Interaction-Aware Retrieval for Agentic Search28 Aug 2026
- 2026BRIDGE: Multimodal-to-Text Retrieval via Reinforcement-Learned Query Alignment8 Apr 2026
- 2026DQA: Diagnostic Question Answering for IT Support7 Apr 2026
- 2026Illocutionary Explanation Planning for Source-Faithful Explanations in Retrieval-Augmented Language Models16 Mar 2026
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning12 Jan 2026
- 2025Test-Time Scaling Strategies for Generative Retrieval in Multimodal Conversational Recommendations25 Aug 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
38 more
- 2025Building Open-Retrieval Conversational Question Answering Systems by Generating Synthetic Data and Decontextualizing User Questions7 Jul 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval29 Apr 2025
- 2025Query Understanding in LLM-based Conversational Information Seeking8 Apr 2025
- 2025HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs6 Mar 2025
- 2025Exploring Rewriting Approaches for Different Conversational Tasks26 Feb 2025
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance24 Feb 2025
- 2025Wizard of Shopping: Target-Oriented E-commerce Dialogue Generation with Decision Tree Branching3 Feb 2025
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024Benchmarking Large Language Models for Conversational Question Answering in Multi-instructional Documents1 Oct 2024
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval3 Aug 2024
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search29 Jul 2024
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrieval23 Jul 2024
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documents17 Jul 2024
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment2 Jul 2024
- 2024Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Components1 Jul 2024
- 2024Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers16 Jun 2024
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search7 Jun 2024
- 2024Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation6 Jun 2024
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval21 Apr 2024
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models17 Apr 2024
- 2024CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewrite18 Mar 2024
- 2024ConvSDG: Session Data Generation for Conversational Search17 Mar 2024
- 2024Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search4 Mar 2024
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversation19 Feb 2024
- 2024CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Models9 Feb 2024
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models30 Jan 2024
- 2024History-Aware Conversational Dense Retrieval30 Jan 2024
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAG18 Jan 2024
- 2023MARRS: Multimodal Reference Resolution System3 Nov 2023
- 2023Multi-User MultiWOZ: Task-Oriented Dialogues among Multiple Users31 Oct 2023
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation20 Oct 2023
- 2023A Use Case: Reformulating Query Rewriting as a Statistical Machine Translation Problem19 Oct 2023
- 2023Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting15 Oct 2023
- 2023Few-Shot Adaptation for Parsing Contextual Utterances with LLMs18 Sep 2023
- 2023Learning to Select the Relevant History Turns in Conversational Question Answering4 Aug 2023
50 newest of 85 All 85 (JSON)
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2026DQA: Diagnostic Question Answering for IT Supportcited by 1
- 2026Illocutionary Explanation Planning for Source-Faithful Explanations in Retrieval-Augmented Language Modelscited by 1
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learningcited by 0
- 2026DQA: Diagnostic Question Answering for IT Support7 Apr 2026
- 2026Illocutionary Explanation Planning for Source-Faithful Explanations in Retrieval-Augmented Language Models16 Mar 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models17 Apr 2024
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models30 Jan 2024
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAG18 Jan 2024
- 2023Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewritingcited by 69
- 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2021MS MARCO: Benchmarking Ranking Models in the Large-Data Regimecited by 28
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2024A Survey of Conversational Searchcited by 22
- 2021Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphscited by 18
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
12 most cited of 69 All 69 (JSON)
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026BRIDGE: Multimodal-to-Text Retrieval via Reinforcement-Learned Query Alignment8 Apr 2026
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval29 Apr 2025
- 2025Query Understanding in LLM-based Conversational Information Seeking8 Apr 2025
- 2025HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs6 Mar 2025
- 2025Exploring Rewriting Approaches for Different Conversational Tasks26 Feb 2025
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance24 Feb 2025
12 newest of 69 All 69 (JSON)