HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data
Not on the map. Why?
Abstract (arXiv)
A pressing challenge in current dialogue systems is to successfully converse with users on topics with information distributed across different modalities. Previous work in multiturn dialogue systems has primarily focused on either text or table information. In more realistic scenarios, having a joint understanding of both is critical as knowledge is typically distributed over both unstructured and structured forms. We present a new dialogue dataset, HybriDialogue, which consists of crowdsourced natural conversations grounded on both Wikipedia text and tables. The conversations are created through the decomposition of complex multihop questions into simple, realistic multiturn dialogue interactions. We propose retrieval, system state tracking, and dialogue response generation tasks for our dataset and conduct baseline experiments for each. Our results show that there is still ample opportunity for improvement, demonstrating the importance of building stronger dialogue systems that can reason over the complex setting of information-seeking dialogue grounded on tables and text.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 28 Apr 2022.
Builds on
28 of 42 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2018CoQA: A Conversational Question Answering Challengecited by 674
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
16 more
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
- 2020Open Question Answering over Tables and Textcited by 163
- 2016Neural Belief Tracker: Data-Driven Dialogue State Trackingcited by 142
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 137
- 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
- 2018A Dataset for Document Grounded Conversationscited by 104
- 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 87
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2018Interpretation of Natural Language Rules in Conversational Machine Readingcited by 72
- 2020KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversationcited by 59
- 2020DoQA -- Accessing Domain-Specific FAQs via Conversational QAcited by 42
- 2018Towards Universal Dialogue State Trackingcited by 33
- 2019DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphscited by 33
- 2018Large-Scale Multi-Domain Belief Tracking with Knowledge Sharingcited by 29
Built on by
Citing papers per year: 2022: 4; 2023: 5; 2024: 12; 2025: 5; 2026: 2.
28 papers.
Sort:
By area:
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
- 2025Table-R1: Region-based Reinforcement Learning for Table Understandingcited by 35
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024CABINET: Content Relevance based Noise Reduction for Table Question Answeringcited by 23
- 2024gTBLS: Generating Tables from Text by Conditional Question Answeringcited by 13
- 2023Unifying Corroborative and Contributive Attributions in Large Language Modelscited by 10
16 more
- 2024cPAPERS: A Dataset of Situated and Multimodal Interactive Conversations in Scientific Paperscited by 10
- 2023LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Controlcited by 8
- 2025EnronQA: Towards Personalized RAG over Private Documentscited by 8
- 2022A Survey on Table-and-Text HybridQA: Concepts, Methods, Challenges and Future Directionscited by 7
- 2023cTBLS: Augmenting Large Language Models with Conversational Tablescited by 7
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcriptscited by 6
- 2024Redefining Proactivity for Information Seeking Dialoguecited by 4
- 2023Multi-User MultiWOZ: Task-Oriented Dialogues among Multiple Userscited by 3
- 2024iTBLS: A Dataset of Interactive Conversations Over Tabular Informationcited by 3
- 2025Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentationcited by 2
- 2025DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilitiescited by 2
- 2025FineDialFact: A benchmark for Fine-grained Dialogue Fact Verificationcited by 1
- 2022Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialogcited by 0
- 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QAcited by 0
- 2026Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucinationcited by 0
- 2026Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination17 Feb 2026
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA10 Feb 2026
- 2025FineDialFact: A benchmark for Fine-grained Dialogue Fact Verification7 Aug 2025
- 2025DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities8 Jul 2025
- 2025Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation14 Jun 2025
- 2025Table-R1: Region-based Reinforcement Learning for Table Understanding18 May 2025
- 2025EnronQA: Towards Personalized RAG over Private Documents1 May 2025
- 2024Redefining Proactivity for Information Seeking Dialogue20 Oct 2024
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversations27 Aug 2024
- 2024cPAPERS: A Dataset of Situated and Multimodal Interactive Conversations in Scientific Papers12 Jun 2024
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts2 May 2024
- 2024iTBLS: A Dataset of Interactive Conversations Over Tabular Information19 Apr 2024
16 more
- 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences31 Mar 2024
- 2024gTBLS: Generating Tables from Text by Conditional Question Answering21 Mar 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answering26 Feb 2024
- 2024On the Multi-turn Instruction Following for Conversational Web Agents23 Feb 2024
- 2024CABINET: Content Relevance based Noise Reduction for Table Question Answering2 Feb 2024
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAG18 Jan 2024
- 2023Unifying Corroborative and Contributive Attributions in Large Language Models20 Nov 2023
- 2023Multi-User MultiWOZ: Task-Oriented Dialogues among Multiple Users31 Oct 2023
- 2023cTBLS: Augmenting Large Language Models with Conversational Tables21 Mar 2023
- 2023Retrieving Multimodal Information for Augmented Generation: A Survey20 Mar 2023
- 2023LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Control6 Feb 2023
- 2022A Survey on Table-and-Text HybridQA: Concepts, Methods, Challenges and Future Directions27 Dec 2022
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance17 Oct 2022
- 2022Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog13 Oct 2022
- 2022Large Language Models are few(1)-shot Table Reasoners13 Oct 2022
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024CABINET: Content Relevance based Noise Reduction for Table Question Answeringcited by 23
- 2024gTBLS: Generating Tables from Text by Conditional Question Answeringcited by 13
- 2023Unifying Corroborative and Contributive Attributions in Large Language Modelscited by 10
- 2024cPAPERS: A Dataset of Situated and Multimodal Interactive Conversations in Scientific Paperscited by 10
- 2023LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Controlcited by 8
- 2022A Survey on Table-and-Text HybridQA: Concepts, Methods, Challenges and Future Directionscited by 7
- 2023cTBLS: Augmenting Large Language Models with Conversational Tablescited by 7
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcriptscited by 6
12 most cited of 20 All 20 (JSON)
- 2026Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination17 Feb 2026
- 2025FineDialFact: A benchmark for Fine-grained Dialogue Fact Verification7 Aug 2025
- 2025DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities8 Jul 2025
- 2025Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation14 Jun 2025
- 2024Redefining Proactivity for Information Seeking Dialogue20 Oct 2024
- 2024cPAPERS: A Dataset of Situated and Multimodal Interactive Conversations in Scientific Papers12 Jun 2024
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcripts2 May 2024
- 2024iTBLS: A Dataset of Interactive Conversations Over Tabular Information19 Apr 2024
- 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences31 Mar 2024
- 2024gTBLS: Generating Tables from Text by Conditional Question Answering21 Mar 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answering26 Feb 2024
12 newest of 20 All 20 (JSON)