Neural Approaches to Conversational Information Retrieval
Not on the map. Why?
Abstract (arXiv)
A conversational information retrieval (CIR) system is an information retrieval (IR) system with a conversational interface which allows users to interact with the system to seek information via multi-turn conversations of natural language, in spoken or written form. Recent progress in deep learning has brought tremendous improvements in natural language processing (NLP) and conversational AI, leading to a plethora of commercial conversational services that allow naturally spoken and typed interaction, increasing the need for more human-centric interactions in IR. As a result, we have witnessed a resurgent interest in developing modern CIR systems in both research communities and industry. This book surveys recent advances in CIR, focusing on neural approaches that have been developed in the last few years. This book is based on the authors' tutorial at SIGIR'2020 (Gao et al., 2020b), with IR and NLP communities as the primary target audience. However, audiences with other background, such as machine learning and human-computer interaction, will also find it an accessible introduction to CIR. We hope that this book will prove a valuable resource for students, researchers, and software developers. This manuscript is a working draft. Comments are welcome.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 123 of its 358 references that are in the map. First posted on arXiv 13 Jan 2022.
Builds on
123 of 358 references.
References · 123
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
38 more
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
- 2018CoQA: A Conversational Question Answering Challengecited by 674
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2019Passage Re-ranking with BERTcited by 629
- 2015Sequence Level Training with Recurrent Neural Networkscited by 568
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
- 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2018QuAC : Question Answering in Contextcited by 379
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 333
- 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2020Evaluation of Text Generation: A Surveycited by 275
- 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 266
- 2020Experience Grounds Languagecited by 241
- 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
- 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 180
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
- 2018Towards Deep Conversational Recommendationscited by 174
- 2018Neural Approaches to Conversational AIcited by 164
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
- 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 141
- 2019Taskmaster-1: Toward a Realistic and Diverse Dialog Datasetcited by 139
50 most cited of 123 All 123 (JSON)
Built on by
Citing papers per year: 2022: 9; 2023: 12; 2024: 12; 2025: 4; 2026: 4.
41 papers.
Sort:
By area:
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialogcited by 50
- 2022Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarizationcited by 29
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
- 2024A Survey of Conversational Searchcited by 22
- 2022METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signalscited by 20
29 more
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
- 2024STYLE: Improving Domain Transferability of Asking Clarification Questions in Large Language Model Powered Conversational Agentscited by 17
- 2022ConTextual Masked Auto-Encoder for Dense Passage Retrievalcited by 16
- 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
- 2023Advancing the Search Frontier with AI Agentscited by 12
- 2023Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answeringcited by 11
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversationscited by 11
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Searchcited by 10
- 2022Query-as-context Pre-training for Dense Passage Retrievalcited by 9
- 2024ConvSDG: Session Data Generation for Conversational Searchcited by 8
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Eracited by 8
- 2022OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experiencecited by 5
- 2023CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrievalcited by 5
- 2023Construction contract risk identification based on knowledge-augmented language modelcited by 5
- 2024History-Aware Conversational Dense Retrievalcited by 4
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrievalcited by 4
- 2023Interactive Text Generationcited by 2
- 2024Position Paper: Agent AI Towards a Holistic Intelligencecited by 2
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documentscited by 2
- 2023What Types of Questions Require Conversation to Answer? A Case Study of AskReddit Questionscited by 1
- 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialoguescited by 1
- 2026Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learningcited by 1
- 2026The P-Completeness of Inverted Index Traversal: On the Complexity of Evaluating Boolean Query DAGscited by 1
- 2022Sparse and Dense Approaches for the Full-rank Retrieval of Responses for Dialoguescited by 0
- 2022Document-Level Abstractive Summarizationcited by 0
- 2024Rewriting Conversational Utterances with Instructed Large Language Modelscited by 0
- 2025Adaptive Personalized Conversational Information Retrievalcited by 0
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Searchcited by 0
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Mergingcited by 0
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2026The P-Completeness of Inverted Index Traversal: On the Complexity of Evaluating Boolean Query DAGs26 Jan 2026
- 2026Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning19 Jan 2026
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations9 Jul 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2024A Survey of Conversational Search21 Oct 2024
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialogues4 Oct 2024
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search29 Jul 2024
29 more
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documents17 Jul 2024
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search7 Jun 2024
- 2024STYLE: Improving Domain Transferability of Asking Clarification Questions in Large Language Model Powered Conversational Agents20 May 2024
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval21 Apr 2024
- 2024ConvSDG: Session Data Generation for Conversational Search17 Mar 2024
- 2024Position Paper: Agent AI Towards a Holistic Intelligence28 Feb 2024
- 2024History-Aware Conversational Dense Retrieval30 Jan 2024
- 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan 2024
- 2023Advancing the Search Frontier with AI Agents2 Nov 2023
- 2023Construction contract risk identification based on knowledge-augmented language model22 Sep 2023
- 2023Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering5 Sep 2023
- 2023Learning to Relate to Previous Turns in Conversational Search5 Jun 2023
- 2023Chatting Makes Perfect: Chat-based Image Retrieval31 May 2023
- 2023ConvGQR: Generative Query Reformulation for Conversational Search25 May 2023
- 2023Leveraging Large Language Models in Conversational Recommender Systems13 May 2023
- 2023CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrieval5 Apr 2023
- 2023What Types of Questions Require Conversation to Answer? A Case Study of AskReddit Questions30 Mar 2023
- 2023Interactive Text Generation2 Mar 2023
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback24 Feb 2023
- 2023Zero-shot Clarifying Question Generation for Conversational Search30 Jan 2023
- 2022Query-as-context Pre-training for Dense Passage Retrieval19 Dec 2022
- 2022Document-Level Abstractive Summarization6 Dec 2022
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trends17 Oct 2022
- 2022Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization21 Aug 2022
- 2022ConTextual Masked Auto-Encoder for Dense Passage Retrieval16 Aug 2022
- 2022OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience24 Jun 2022
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialog22 Jun 2022
- 2022Sparse and Dense Approaches for the Full-rank Retrieval of Responses for Dialogues22 Apr 2022
- 2022METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals13 Apr 2022
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialogcited by 50
- 2022Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarizationcited by 29
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
- 2024A Survey of Conversational Searchcited by 22
- 2022METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signalscited by 20
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 18
- 2022ConTextual Masked Auto-Encoder for Dense Passage Retrievalcited by 16
12 most cited of 35 All 35 (JSON)
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2025Adaptive Personalized Conversational Information Retrieval12 Aug 2025
- 2025ConvMix: A Mixed-Criteria Data Augmentation Framework for Conversational Dense Retrieval6 Aug 2025
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations9 Jul 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2024A Survey of Conversational Search21 Oct 2024
- 2024Rewriting Conversational Utterances with Instructed Large Language Models10 Oct 2024
- 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialogues4 Oct 2024
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search29 Jul 2024
- 2024Conversational Query Reformulation with the Guidance of Retrieved Documents17 Jul 2024
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search7 Jun 2024
12 newest of 35 All 35 (JSON)