TopiOCQA: Open-domain Conversational Question Answering with Topic Switching
Not on the map. Why?
Cited by 21 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In a conversational question answering scenario, a questioner seeks to extract information about a topic through a series of interdependent questions and answers. As the conversation progresses, they may switch to related topics, a phenomenon commonly observed in information-seeking search sessions. However, current datasets for conversational question answering are limiting in two ways: 1) they do not contain topic switches; and 2) they assume the reference text for the conversation is given, i.e., the setting is not open-domain. We introduce TopiOCQA (pronounced Tapioca), an open-domain conversational dataset with topic switches on Wikipedia. TopiOCQA contains 3,920 conversations with information-seeking questions and free-form answers. On average, a conversation in our dataset spans 13 question-answer turns and involves four topics (documents). TopiOCQA poses a challenging test-bed for models, where efficient retrieval is required on multiple turns of the same conversation, in conjunction with constructing valid responses using conversational history. We evaluate several baselines, by combining state-of-the-art document retrieval methods with neural reader models. Our best model achieves F1 of 55.8, falling short of human performance by 14.2 points, indicating the difficulty of our dataset. Our dataset and code is available at https://mcgill-nlp.github.io/topiocqa
Key facts. Cited by 96 papers in the map (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 2 Oct 2021.
Builds on
29 of 43 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
17 more
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2018CoQA: A Conversational Question Answering Challengecited by 683
- 2017The NarrativeQA Reading Comprehension Challengecited by 597
- 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 571
- 2018QuAC : Question Answering in Contextcited by 381
- 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 148
- 2014Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)cited by 109
- 2020Open-Retrieval Conversational Question Answeringcited by 99
- 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
- 2020Question Rewriting for Conversational Question Answeringcited by 93
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2019BERT with History Answer Embedding for Conversational Question Answeringcited by 67
- 2020TREC CAsT 2019: The Conversational Assistance Track Overviewcited by 64
- 2019Attentive History Selection for Conversational Question Answeringcited by 33
- 2018SDNet: Contextualized Attention-based Deep Network for Conversational Question Answeringcited by 30
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 18; 2024: 32; 2025: 23; 2026: 17.
96 papers.
Sort:
By area:
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 201
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
- 2023The Generative AI Paradox: "What It Can Create, It May Not Understand"cited by 98
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 97
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2024Instruction Pre-Training: Language Models are Supervised Multitask Learnerscited by 63
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 56
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 42
38 more
- 2024Knowledge Boundary of Large Language Models: A Surveycited by 40
- 2023PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adaptercited by 38
- 2025Search Arena: Analyzing Search-Augmented LLMscited by 34
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2022INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactionscited by 27
- 2023The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational Question Answeringcited by 26
- 2023Learning to Relate to Previous Turns in Conversational Searchcited by 26
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 25
- 2024CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemscited by 25
- 2024Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Checkcited by 24
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
- 2024A Survey of Conversational Searchcited by 22
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 22
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 19
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 19
- 2024Conv-CoA: Improving Open-domain Question Answering in Large Language Models via Conversational Chain-of-Actioncited by 19
- 2024Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentationcited by 17
- 2024Writing Style Matters: An Examination of Bias and Fairness in Information Retrieval Systemscited by 15
- 2024AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignmentcited by 14
- 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Methodcited by 12
- 2024XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inferencecited by 12
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversationscited by 12
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Searchcited by 11
- 2023textitDial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuningcited by 9
- 2024Structured Chain-of-Thought Prompting for Few-Shot Generation of Content-Grounded QA Conversationscited by 9
- 2024Assessing "Implicit" Retrieval Robustness of Large Language Modelscited by 9
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Searchcited by 9
- 2025EnronQA: Towards Personalized RAG over Private Documentscited by 9
- 2025REFRAG: Rethinking RAG based Decodingcited by 9
- 2022Open-Domain Conversational Question Answering with Historical Answerscited by 8
- 2024ConvSDG: Session Data Generation for Conversational Searchcited by 8
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Eracited by 8
- 2024Beyond Persuasion: Towards Conversational Recommender System with Credible Explanationscited by 7
- 2025Multi-Agent LLM Judge: automatic personalized LLM judge design for evaluating natural language generation applicationscited by 7
50 most cited of 96 All 96 (JSON)
- 2026RALI@iKAT 2026: Retrieval-aware User Profile Denoising via Personalized Conversational Dense Retrieval13 Oct 2026
- 2026Role-aware Heuristic Episodic Attention for Conversational LLMs1 Oct 2026
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026Reconstructing the Right Episode: Evaluating Interleaved Conversational Memory Beyond Long Context26 Aug 2026
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models31 Jul 2026
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2026MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks20 May 2026
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs10 May 2026
- 2026AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs14 Apr 2026
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
38 more
- 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue7 Apr 2026
- 2026AILS-NTUA at SemEval-2026 Task 8: Evaluating Multi-Turn RAG Conversations11 Mar 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
- 2026Evaluating the Utility of Grounding Documents with Reference-Free LLM-based Metrics30 Jan 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications19 Oct 2025
- 2025A Longitudinal Study on Different Annotator Feedback Loops in Complex RAG Tasks13 Oct 2025
- 2025Prepared mind, fast response: A temporal decoupling framework for adaptive knowledge orchestration in open-domain dialogue9 Oct 2025
- 2025Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?26 Sep 2025
- 2025KnowMT-Bench: Benchmarking Knowledge-Intensive Long-Form Question Answering in Multi-Turn Dialogues26 Sep 2025
- 2025CIFLEX: Contextual Instruction Flow for Sub-task Execution in Multi-Turn Interactions with a Single On-Device LLM24 Sep 2025
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systems6 Sep 2025
- 2025ICR: Iterative Clarification and Rewriting for Conversational Search5 Sep 2025
- 2025REFRAG: Rethinking RAG based Decoding1 Sep 2025
- 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs13 Jul 2025
- 2025UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations9 Jul 2025
- 2025DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities8 Jul 2025
- 2025Conversational Search: From Fundamentals to Frontiers in the LLM Era12 Jun 2025
- 2025Search Arena: Analyzing Search-Augmented LLMs5 Jun 2025
- 2025IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data3 Jun 2025
- 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptation2 Jun 2025
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2025EnronQA: Towards Personalized RAG over Private Documents1 May 2025
- 2025Query Understanding in LLM-based Conversational Information Seeking8 Apr 2025
- 2025Multi-Agent LLM Judge: automatic personalized LLM judge design for evaluating natural language generation applications1 Apr 2025
- 2025Towards Lighter and Robust Evaluation for Retrieval Augmented Generation20 Mar 2025
- 2025Hierarchical Retrieval at Scale: Bridging Transparency and Efficiency11 Feb 2025
- 2025Wormhole Memory: A Rubik's Cube for Cross-Dialogue Retrieval24 Jan 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024Knowledge Boundary of Large Language Models: A Survey17 Dec 2024
- 2024Writing Style Matters: An Examination of Bias and Fairness in Information Retrieval Systems20 Nov 2024
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search18 Oct 2024
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA23 Sep 2024
- 2024Beyond Persuasion: Towards Conversational Recommender System with Credible Explanations22 Sep 2024
- 2024CoDi: Conversational Distillation for Grounded Question Answering20 Aug 2024
- 2024Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search29 Jul 2024
50 newest of 96 All 96 (JSON)
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2023PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adaptercited by 38
- 2024CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemscited by 25
- 2024Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Checkcited by 24
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 22
- 2024Assessing "Implicit" Retrieval Robustness of Large Language Modelscited by 9
- 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
- 2025EnronQA: Towards Personalized RAG over Private Documentscited by 9
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generationcited by 8
- 2024A Survey of Query Optimization in Large Language Modelscited by 1
- 2025Towards Lighter and Robust Evaluation for Retrieval Augmented Generationcited by 0
12 most cited of 19 All 19 (JSON)
- 2026MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks20 May 2026
- 2026AILS-NTUA at SemEval-2026 Task 8: Evaluating Multi-Turn RAG Conversations11 Mar 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
- 2026Evaluating the Utility of Grounding Documents with Reference-Free LLM-based Metrics30 Jan 2026
- 2026When should I search more: Adaptive Complex Query Optimization with Reinforcement Learning29 Jan 2026
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications19 Oct 2025
- 2025A Longitudinal Study on Different Annotator Feedback Loops in Complex RAG Tasks13 Oct 2025
- 2025Can Synthetic Query Rewrites Capture User Intent Better than Humans in Retrieval-Augmented Generation?26 Sep 2025
- 2025EnronQA: Towards Personalized RAG over Private Documents1 May 2025
- 2025Towards Lighter and Robust Evaluation for Retrieval Augmented Generation20 Mar 2025
- 2024A Survey of Query Optimization in Large Language Models23 Dec 2024
- 2024CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation30 Oct 2024
12 newest of 19 All 19 (JSON)
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 201
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversationcited by 23
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Searchcited by 1
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulationcited by 0
- 2026Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search8 Apr 2026
- 2025References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation10 May 2025
- 2024Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversation19 Feb 2024
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets20 Jul 2023
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
- 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
- 2023The Generative AI Paradox: "What It Can Create, It May Not Understand"cited by 98
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 97
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2024Instruction Pre-Training: Language Models are Supervised Multitask Learnerscited by 63
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 56
- 2024Knowledge Boundary of Large Language Models: A Surveycited by 40
- 2025Search Arena: Analyzing Search-Augmented LLMscited by 34
- 2024CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Searchcited by 29
- 2022INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactionscited by 27
12 most cited of 65 All 65 (JSON)
- 2026RALI@iKAT 2026: Retrieval-aware User Profile Denoising via Personalized Conversational Dense Retrieval13 Oct 2026
- 2026Role-aware Heuristic Episodic Attention for Conversational LLMs1 Oct 2026
- 2026CompCQR: Compositional Query Generation for Training-Free Conversational Search13 Sep 2026
- 2026Reconstructing the Right Episode: Evaluating Interleaved Conversational Memory Beyond Long Context26 Aug 2026
- 2026M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models31 Jul 2026
- 2026Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging9 Jul 2026
- 2026uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking10 Jun 2026
- 2026RCEM: Robust Conversational Search EMbedder in Distributional Shift1 Jun 2026
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs10 May 2026
- 2026AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs14 Apr 2026
- 2025Prepared mind, fast response: A temporal decoupling framework for adaptive knowledge orchestration in open-domain dialogue9 Oct 2025
- 2025KnowMT-Bench: Benchmarking Knowledge-Intensive Long-Form Question Answering in Multi-Turn Dialogues26 Sep 2025
12 newest of 65 All 65 (JSON)