Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting
Not on the map. Why?
Abstract (arXiv)
Query rewriting plays a vital role in enhancing conversational search by transforming context-dependent user queries into standalone forms. Existing approaches primarily leverage human-rewritten queries as labels to train query rewriting models. However, human rewrites may lack sufficient information for optimal retrieval performance. To overcome this limitation, we propose utilizing large language models (LLMs) as query rewriters, enabling the generation of informative query rewrites through well-designed instructions. We define four essential properties for well-formed rewrites and incorporate all of them into the instruction. In addition, we introduce the role of rewrite editors for LLMs when initial query rewrites are available, forming a "rewrite-then-edit" process. Furthermore, we propose distilling the rewriting capabilities of LLMs into smaller models to reduce rewriting latency. Our experimental evaluation on the QReCC dataset demonstrates that informative query rewrites can yield substantially improved retrieval performance compared to human rewrites, especially with sparse retrievers.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 15 Oct 2023.
Builds on
39 of 65 references.
References · 39
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
27 more
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2023In-Context Retrieval-Augmented Language Modelscited by 694
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2023Larger language models do in-context learning differentlycited by 386
- 2018QuAC : Question Answering in Contextcited by 379
- 2022Teaching Small Language Models to Reasoncited by 279
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
- 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
- 2020Question Rewriting for Conversational Question Answeringcited by 93
- 2020Few-Shot Generative Conversational Query Rewritingcited by 85
- 2021Few-Shot Conversational Dense Retrievalcited by 71
- 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2022Can Large Language Models Truly Understand Prompts? A Case Study with Negated Promptscited by 56
- 2020Query Resolution for Conversational Search with Limited Supervisioncited by 52
- 2018Pytrec_eval: An Extremely Fast Python Interface to trec_evalcited by 46
- 2020Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Modelscited by 45
- 2021Contextualized Query Embeddings for Conversational Searchcited by 36
- 2023Exploiting Simulated User Feedback for Conversational Search: Ranking, Rewriting, and Beyondcited by 23
- 2023An In-depth Investigation of User Response Simulation for Conversational Searchcited by 20
- 2022Reinforced Question Rewriting for Conversational Question Answeringcited by 19
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2023How Does In-Context Learning Help Prompt Tuning?cited by 11
- 2022McQueen: a Benchmark for Multimodal Conversational Query Rewritecited by 6
Built on by
Citing papers per year: 2023: 1; 2024: 27; 2025: 27; 2026: 14.
69 papers.
Sort:
By area:
- 2024Benchmarking LLMs via Uncertainty Quantificationcited by 124
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2024RaFe: Ranking Feedback Improves Query Rewriting for RAGcited by 47
- 2025Think Then Embed: Generative Context Improves Multimodal Embeddingcited by 39
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024A Survey of Conversational Searchcited by 22
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Modelscited by 19
- 2024Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Actioncited by 19
38 more
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLMcited by 18
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
- 2024Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentationcited by 16
- 2024Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answerscited by 15
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignmentcited by 14
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversationscited by 11
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 10
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Searchcited by 10
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidancecited by 10
- 2024MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Modelscited by 9
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2025TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrievalcited by 9
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Searchcited by 8
- 2025SPAR: Scholar Paper Retrieval with LLM-based Agents for Enhanced Academic Searchcited by 7
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planningcited by 7
- 2025RANGER -- Repository-Level Agent for Graph-Enhanced Retrievalcited by 7
- 2026TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrievalcited by 7
- 2024CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Modelscited by 6
- 2024CursorCore: Assist Programming through Aligning Anythingcited by 6
- 2025Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Surveycited by 6
- 2024Face the Facts! Evaluating RAG-based Pipelines for Professional Fact-Checkingcited by 5
- 2024History-Aware Conversational Dense Retrievalcited by 4
- 2025Automatic Input Rewriting Improves Translation with Large Language Modelscited by 4
- 2025Query Understanding in LLM-based Conversational Information Seekingcited by 4
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrievalcited by 4
- 2025ICR: Iterative Clarification and Rewriting for Conversational Searchcited by 4
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Searchcited by 4
- 2024Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Componentscited by 3
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documentscited by 2
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Datacited by 2
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquirycited by 2
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrievalcited by 2
- 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptationcited by 2
- 2025Investigating LLM Variability in Personalized Conversational Information Retrievalcited by 2
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planningcited by 2
- 2024A Survey of Query Optimization in Large Language Modelscited by 1
- 2025QueStER: Query Specification for Generative keyword-based Retrievalcited by 1
- 2026ReCQR: Incorporating conversational query rewriting to improve Multimodal Image Retrievalcited by 1
50 most cited of 69 All 69 (JSON)
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026Search-GRT: Guided Retrieval Training of Search Agents to Optimize for Complex Question Answering2 Aug 2026
- 2026CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchanges18 Jun 2026
- 2026Clarify-Then-Search: A Clarification Benchmark for Deep Search with End-to-End Nugget Restoration17 Jun 2026
- 2026Measuring Semantic Progress in Multi-turn Dialogue via Information Gain10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search8 May 2026
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspective1 May 2026
- 2026Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelines24 Apr 2026
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
- 2026TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrieval3 Mar 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
38 more
- 2026ReCQR: Incorporating conversational query rewriting to improve Multimodal Image Retrieval19 Jan 2026
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning12 Jan 2026
- 2025NILC: Discovering New Intents with LLM-assisted Clustering8 Nov 2025
- 2025QueStER: Query Specification for Generative keyword-based Retrieval7 Nov 2025
- 2025DMA: Online RAG Alignment with Human Feedback6 Nov 2025
- 2025Think Then Embed: Generative Context Improves Multimodal Embedding6 Oct 2025
- 2025Investigating LLM Variability in Personalized Conversational Information Retrieval4 Oct 2025
- 2025RANGER -- Repository-Level Agent for Graph-Enhanced Retrieval27 Sep 2025
- 2025Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?26 Sep 2025
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion19 Sep 2025
- 2025ICR: Iterative Clarification and Rewriting for Conversational Search5 Sep 2025
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planning29 Aug 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
- 2025SPAR: Scholar Paper Retrieval with LLM-based Agents for Enhanced Academic Search21 Jul 2025
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations9 Jul 2025
- 2025Building Open-Retrieval Conversational Question Answering Systems by Generating Synthetic Data and Decontextualizing User Questions7 Jul 2025
- 2025When LLMs Disagree: Diagnosing Relevance Filtering Bias and Retrieval Divergence in SDG Search2 Jul 2025
- 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptation2 Jun 2025
- 2025Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey18 May 2025
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval29 Apr 2025
- 2025Query Understanding in LLM-based Conversational Information Seeking8 Apr 2025
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning31 Mar 2025
- 2025TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval28 Feb 2025
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance24 Feb 2025
- 2025Automatic Input Rewriting Improves Translation with Large Language Models23 Feb 2025
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquiry12 Feb 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024Face the Facts! Evaluating RAG-based Pipelines for Professional Fact-Checking19 Dec 2024
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Data17 Nov 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search18 Oct 2024
- 2024CursorCore: Assist Programming through Aligning Anything9 Oct 2024
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA23 Sep 2024
- 2024MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Models30 Aug 2024
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval3 Aug 2024
50 newest of 69 All 69 (JSON)
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024RaFe: Ranking Feedback Improves Query Rewriting for RAGcited by 47
- 2024MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Modelscited by 9
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2025TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrievalcited by 9
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Datacited by 2
- 2024A Survey of Query Optimization in Large Language Modelscited by 1
- 2026Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelinescited by 1
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspectivecited by 1
- 2025Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?cited by 0
- 2025DMA: Online RAG Alignment with Human Feedbackcited by 0
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QAcited by 0
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspective1 May 2026
- 2026Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelines24 Apr 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
- 2025DMA: Online RAG Alignment with Human Feedback6 Nov 2025
- 2025Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?26 Sep 2025
- 2025TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval28 Feb 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Data17 Nov 2024
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA23 Sep 2024
- 2024MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Models30 Aug 2024
- 2024RaFe: Ranking Feedback Improves Query Rewriting for RAG23 May 2024
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAG18 Jan 2024
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLMcited by 18
- 2025SPAR: Scholar Paper Retrieval with LLM-based Agents for Enhanced Academic Searchcited by 7
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planningcited by 7
- 2024CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Modelscited by 6
- 2025Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Surveycited by 6
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Searchcited by 4
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquirycited by 2
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planningcited by 2
- 2026Search-GRT: Guided Retrieval Training of Search Agents to Optimize for Complex Question Answeringcited by 0
- 2026Search-GRT: Guided Retrieval Training of Search Agents to Optimize for Complex Question Answering2 Aug 2026
- 2026InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search8 May 2026
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning12 Jan 2026
- 2025RECAP: REwriting Conversations for Intent Understanding in Agentic Planning29 Aug 2025
- 2025SPAR: Scholar Paper Retrieval with LLM-based Agents for Enhanced Academic Search21 Jul 2025
- 2025Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey18 May 2025
- 2025A New Query Expansion Approach via Agent-Mediated Dialogic Inquiry12 Feb 2025
- 2024CoSearchAgent: A Lightweight Collaborative Search Agent with Large Language Models9 Feb 2024
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLM24 Dec 2023
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answerscited by 15
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Searchcited by 1
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulationcited by 0
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2024Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers16 Jun 2024
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversation19 Feb 2024
- 2024Benchmarking LLMs via Uncertainty Quantificationcited by 124
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2024A Survey of Conversational Searchcited by 22
- 2024Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Actioncited by 19
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
- 2024Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentationcited by 16
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignmentcited by 14
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversationscited by 11
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 10
12 most cited of 40 All 40 (JSON)
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchanges18 Jun 2026
- 2026Clarify-Then-Search: A Clarification Benchmark for Deep Search with End-to-End Nugget Restoration17 Jun 2026
- 2026Measuring Semantic Progress in Multi-turn Dialogue via Information Gain10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2026ReCQR: Incorporating conversational query rewriting to improve Multimodal Image Retrieval19 Jan 2026
- 2025NILC: Discovering New Intents with LLM-assisted Clustering8 Nov 2025
- 2025QueStER: Query Specification for Generative keyword-based Retrieval7 Nov 2025
- 2025Investigating LLM Variability in Personalized Conversational Information Retrieval4 Oct 2025
- 2025RANGER -- Repository-Level Agent for Graph-Enhanced Retrieval27 Sep 2025
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion19 Sep 2025
- 2025ICR: Iterative Clarification and Rewriting for Conversational Search5 Sep 2025
12 newest of 40 All 40 (JSON)