Large Language Models Know Your Contextual Search Intent: A Prompting Framework for Conversational Search
Not on the map. Why?
Abstract (arXiv)
Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show unsatisfactory effectiveness and robustness to handle real conversational search scenarios. Recently, large language models (LLMs) have demonstrated amazing capabilities for text generation and conversation understanding. In this work, we present a simple yet effective prompting framework, called LLM4CS, to leverage LLMs as a text-based search intent interpreter to help conversational search. Under this framework, we explore three prompting methods to generate multiple query rewrites and hypothetical responses, and propose to aggregate them into an integrated representation that can robustly represent the user's real contextual search intent. Extensive automatic evaluations and human evaluations on three widely used conversational search benchmarks, including CAsT-19, CAsT-20, and CAsT-21, demonstrate the remarkable performance of our simple LLM4CS framework compared with existing methods and even using human rewrites. Our findings provide important evidence to better understand and leverage LLMs for conversational search.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Mar 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 11; 2024: 32; 2025: 21; 2026: 11.
75 papers.
Sort:
By area:
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 52
- 2023RETA-LLM: A Retrieval-Augmented Large Language Model Toolkitcited by 40
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 33
- 2024Grounding Language Model with Chunking-Free In-Context Retrievalcited by 30
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMscited by 29
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2023MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansioncited by 23
38 more
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024A Survey of Conversational Searchcited by 22
- 2024INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuningcited by 20
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 19
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Modelscited by 19
- 2023GAR-meets-RAG Paradigm for Zero-Shot Information Retrievalcited by 18
- 2024Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentationcited by 17
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agentcited by 17
- 2024Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulationcited by 15
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignmentcited by 14
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversationscited by 12
- 2023Synergistic Interplay between Search and Large Language Models for Information Retrievalcited by 11
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrievalcited by 11
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Searchcited by 11
- 2024AMPO: Automatic Multi-Branched Prompt Optimizationcited by 11
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Searchcited by 9
- 2024ConvSDG: Session Data Generation for Conversational Searchcited by 8
- 2024Toward Conversational Agents with Context and Time Sensitive Long-term Memorycited by 8
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Eracited by 8
- 2024Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorercited by 7
- 2025SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Modelscited by 7
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Enginecited by 6
- 2024Evaluating Search Engines and Large Language Models for Answering Health Questionscited by 5
- 2025Query Understanding in LLM-based Conversational Information Seekingcited by 5
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrievalcited by 5
- 2025Role-Augmented Intent-Driven Generative Search Engine Optimizationcited by 5
- 2024History-Aware Conversational Dense Retrievalcited by 4
- 2025ICR: Iterative Clarification and Rewriting for Conversational Searchcited by 4
- 2024Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Componentscited by 3
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planningcited by 3
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documentscited by 2
- 2024Enhancing Risk Assessment in Transformers with Loss-at-Risk Functionscited by 2
- 2024SRSA: A Cost-Efficient Strategy-Router Search Agent for Real-world Human-Machine Interactionscited by 2
- 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptationcited by 2
- 2025Investigating LLM Variability in Personalized Conversational Information Retrievalcited by 2
- 2023Few-Shot Adaptation for Parsing Contextual Utterances with LLMscited by 1
50 most cited of 75 All 75 (JSON)
- 2026RALI@iKAT 2026: Retrieval-aware User Profile Denoising via Personalized Conversational Dense Retrieval13 Oct 2026
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026Neighborhood-Aware Dual Biomedical Entity Linking4 Aug 2026
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspective1 May 2026
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
- 2026RAG without Forgetting: Continual Query-Infused Key Memory5 Feb 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2026Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning12 Jan 2026
- 2025Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrieval21 Oct 2025
38 more
- 2025Investigating LLM Variability in Personalized Conversational Information Retrieval4 Oct 2025
- 2025Finding Diamonds in Conversation Haystacks: A Benchmark for Conversational Data Retrieval3 Oct 2025
- 2025ICR: Iterative Clarification and Rewriting for Conversational Search5 Sep 2025
- 2025Role-Augmented Intent-Driven Generative Search Engine Optimization15 Aug 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations9 Jul 2025
- 2025IMAIA: Interactive Maps AI Assistant for Travel Planning and Geo-Spatial Intelligence9 Jul 2025
- 2025Building Open-Retrieval Conversational Question Answering Systems by Generating Synthetic Data and Decontextualizing User Questions7 Jul 2025
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent30 Jun 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2025KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG3 Jun 2025
- 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptation2 Jun 2025
- 2025WXImpactBench: A Disruptive Weather Impact Understanding Benchmark for Evaluating Large Language Models26 May 2025
- 2025GAP: Graph-Assisted Prompts for Dialogue-based Medication Recommendation19 May 2025
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2025SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Models8 May 2025
- 2025Query Understanding in LLM-based Conversational Information Seeking8 Apr 2025
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning31 Mar 2025
- 2025Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs21 Mar 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024SRSA: A Cost-Efficient Strategy-Router Search Agent for Real-world Human-Machine Interactions21 Nov 2024
- 2024Enhancing Risk Assessment in Transformers with Loss-at-Risk Functions4 Nov 2024
- 2024Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer31 Oct 2024
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search18 Oct 2024
- 2024AMPO: Automatic Multi-Branched Prompt Optimization11 Oct 2024
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine8 Oct 2024
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs30 Sep 2024
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA23 Sep 2024
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval3 Aug 2024
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search29 Jul 2024
- 2024How to Leverage Personal Textual Knowledge for Personalized Conversational Information Retrieval23 Jul 2024
- 2024Evaluating Search Engines and Large Language Models for Answering Health Questions17 Jul 2024
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documents17 Jul 2024
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment2 Jul 2024
50 newest of 75 All 75 (JSON)
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2023RETA-LLM: A Retrieval-Augmented Large Language Model Toolkitcited by 40
- 2024Grounding Language Model with Chunking-Free In-Context Retrievalcited by 30
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2024Toward Conversational Agents with Context and Time Sensitive Long-term Memorycited by 8
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2024Evaluating Search Engines and Large Language Models for Answering Health Questionscited by 5
- 2025Role-Augmented Intent-Driven Generative Search Engine Optimizationcited by 5
- 2024A Survey of Query Optimization in Large Language Modelscited by 1
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspectivecited by 1
- 2025KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAGcited by 0
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026LLM-Oriented Information Retrieval: A Denoising-First Perspective1 May 2026
- 2026RAG without Forgetting: Continual Query-Infused Key Memory5 Feb 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2025Role-Augmented Intent-Driven Generative Search Engine Optimization15 Aug 2025
- 2025KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG3 Jun 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA23 Sep 2024
- 2024Evaluating Search Engines and Large Language Models for Answering Health Questions17 Jul 2024
- 2024Toward Conversational Agents with Context and Time Sensitive Long-term Memory29 May 2024
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb 2024
- 2024Grounding Language Model with Chunking-Free In-Context Retrieval15 Feb 2024
12 newest of 13 All 13 (JSON)
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMscited by 29
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agentcited by 17
- 2024Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorercited by 7
- 2025SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Modelscited by 7
- 2025Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent30 Jun 2025
- 2025SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Models8 May 2025
- 2024Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer31 Oct 2024
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs30 Sep 2024
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Searchcited by 1
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulationcited by 0
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversation19 Feb 2024
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Searchcited by 9
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Enginecited by 6
- 2025Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMscited by 0
- 2025Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs21 Mar 2025
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search18 Oct 2024
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine8 Oct 2024
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 52
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 33
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2023MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansioncited by 23
- 2024A Survey of Conversational Searchcited by 22
- 2024INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuningcited by 20
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 19
- 2023GAR-meets-RAG Paradigm for Zero-Shot Information Retrievalcited by 18
12 most cited of 48 All 48 (JSON)
- 2026RALI@iKAT 2026: Retrieval-aware User Profile Denoising via Personalized Conversational Dense Retrieval13 Oct 2026
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026Neighborhood-Aware Dual Biomedical Entity Linking4 Aug 2026
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2025Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrieval21 Oct 2025
- 2025Investigating LLM Variability in Personalized Conversational Information Retrieval4 Oct 2025
- 2025Finding Diamonds in Conversation Haystacks: A Benchmark for Conversational Data Retrieval3 Oct 2025
- 2025ICR: Iterative Clarification and Rewriting for Conversational Search5 Sep 2025
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
12 newest of 48 All 48 (JSON)