HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data
Not on the map. Why?
Cited by 51 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Existing question answering datasets focus on dealing with homogeneous information, based either only on text or KB/Table information alone. However, as human knowledge is distributed over heterogeneous forms, using homogeneous information alone might lead to severe coverage problems. To fill in the gap, we present HybridQA https://github.com/wenhuchen/HybridQA, a new large-scale question-answering dataset that requires reasoning on heterogeneous information. Each question is aligned with a Wikipedia table and multiple free-form corpora linked with the entities in the table. The questions are designed to aggregate both tabular information and text information, i.e., lack of either form would render the question unanswerable. We test with three different models: 1) a table-only model. 2) text-only model. 3) a hybrid model that combines heterogeneous information to find the answer. The experimental results show that the EM scores obtained by two baselines are below 20%, while the hybrid model can achieve an EM over 40%. This gap suggests the necessity to aggregate heterogeneous information in HybridQA. However, the hybrid model's score is still far behind human performance. Hence, HybridQA can serve as a challenging benchmark to study question answering with heterogeneous information.
Key facts. Cited by 264 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 43; 2023: 38; 2024: 60; 2025: 54; 2026: 38.
264 papers.
Sort:
By area:
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2022UL2: Unifying Language Learning Paradigmscited by 295
- 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 235
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2021FeTaQA: Free-form Table Question Answeringcited by 175
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
38 more
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
- 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 137
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 118
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
- 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
- 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
- 2024CompAct: Compressing Retrieved Documents Actively for Question Answeringcited by 64
- 2023Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasonerscited by 63
- 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 63
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
- 2021MATE: Multi-view Attention for Table Transformer Efficiencycited by 54
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 50
- 2022Don't Blame the Annotator: Bias Already Starts in the Annotation Instructionscited by 47
- 2022Reasoning Like Program Executorscited by 45
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2022A Survey on Table Question Answering: Recent Advancescited by 41
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2021Zero-shot Visual Question Answering using Knowledge Graphcited by 37
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2023TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoningcited by 32
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
- 2021ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answerscited by 29
- 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examplescited by 29
- 2024StructLM: Towards Building Generalist Models for Structured Knowledge Groundingcited by 29
- 2024A Survey of Useful LLM Evaluationcited by 29
- 2022HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Datacited by 28
- 2023Large Language Models are Complex Table Parserscited by 28
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 28
50 most cited of 264 All 264 (JSON)
- 2026Structured Composition of Verifiable Atomic Insights for Table-to-Report Generation2 Oct 2026
- 2026When Harness Beats Scale, and When Reading Beats Both28 Sep 2026
- 2026TableSeek: Structure-Preserving Agentic Evidence Seeking over Heterogeneous Table Corpora28 Sep 2026
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning26 Sep 2026
- 2026ORCA: Evaluating LLMs on Data Science Code Translation25 Sep 2026
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026CIPHER: Benchmarking Cross-record Inference over Privacy-Hardened Evidence Records7 Sep 2026
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering31 Aug 2026
- 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges12 Aug 2026
- 2026An Actionable Diagnosis of Multilingual, Multi-Agent Planning Failures4 Aug 2026
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces4 Aug 2026
38 more
- 2026Baikal: Structured Search for Deep Research over Data Lakes30 Jul 2026
- 2026Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs28 Jul 2026
- 2026WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing28 Jul 2026
- 2026Semantically Similar, Logically Distinct: Diagnosing the Semantic-Answerability Gap in Table RAG20 Jul 2026
- 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes14 Jul 2026
- 2026GDP.pdf: Benchmarking Grounded Multimodal Reasoning over Professional PDF Documents13 Jul 2026
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows29 Jun 2026
- 2026Ko-WideSearch: A Korean Breadth-Search Benchmark for Exhaustive Set Enumeration by Web Agents25 Jun 2026
- 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges14 Jun 2026
- 2026CODA-BENCH: Can Code Agents Handle Data-Intensive Tasks?13 Jun 2026
- 2026LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake9 Jun 2026
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2026Query Symbolically or Retrieve Semantically? A Dataset and Method for Semi-Structured Question Answering26 May 2026
- 2026Stage-Audit: Auditable Source-Frontier Discovery for Cross-Wiki Tables19 May 2026
- 2026IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review23 Apr 2026
- 2026Generalizing Numerical Reasoning in Table Data through Operation Sketches and Self-Supervised Learning23 Apr 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documents2 Apr 2026
- 2026Agentic DAG-Orchestrated Planner Framework for Multi-Modal, Multi-Hop Question Answering in Hybrid Data Lakes15 Mar 2026
- 2026SPARTA: Scalable and Principled Benchmark of Tree-Structured Multi-hop QA over Text and Tables26 Feb 2026
- 2026HELIOS: Harmonizing Early Fusion, Late Fusion, and LLM Reasoning for Multi-Granular Table-Text Retrieval25 Feb 2026
- 2026ViMultiChoice: Toward a Method That Gives Explanation for Multiple-Choice Reading Comprehension in Vietnamese10 Feb 2026
- 2026WideSeek-R1: Exploring Width Scaling for Broad Information Seeking via Multi-Agent Reinforcement Learning4 Feb 2026
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models2 Feb 2026
- 2026SpectraQuery: A Hybrid Retrieval-Augmented Conversational Assistant for Battery Science14 Jan 2026
- 2026An Empirical Investigation of Robustness in Large Language Models under Tabular Distortions8 Jan 2026
- 2025RePo: Language Models with Context Re-Positioning16 Dec 2025
- 2025JT-DA: Enhancing Data Analysis with Tool-Integrated Table Reasoning Large Language Models7 Dec 2025
- 2025Instruction Tuning of Large Language Models for Tabular Data Generation-in One Day28 Nov 2025
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?27 Oct 2025
- 2025RELOOP: Recursive Retrieval with Multi-Hop Reasoner and Planners for Heterogeneous QA23 Oct 2025
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science19 Oct 2025
- 2025PISA: A Pragmatic Psych-Inspired Unified Memory System for Enhanced AI Agency12 Oct 2025
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoning7 Oct 2025
- 2025SCRIBES: Web-Scale Script-Based Semi-Structured Data Extraction with Reinforcement Learning2 Oct 2025
- 2025Same Content, Different Representations: A Controlled Study for Table QA26 Sep 2025
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding25 Sep 2025
50 newest of 264 All 264 (JSON)
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 235
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 162
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 118
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
- 2023Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasonerscited by 63
- 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 63
- 2022Reasoning Like Program Executorscited by 45
- 2023TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoningcited by 32
- 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examplescited by 29
12 most cited of 51 All 51 (JSON)
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning26 Sep 2026
- 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges12 Aug 2026
- 2026SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges14 Jun 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2026HELIOS: Harmonizing Early Fusion, Late Fusion, and LLM Reasoning for Multi-Granular Table-Text Retrieval25 Feb 2026
- 2026SpectraQuery: A Hybrid Retrieval-Augmented Conversational Assistant for Battery Science14 Jan 2026
- 2025JT-DA: Enhancing Data Analysis with Tool-Integrated Table Reasoning Large Language Models7 Dec 2025
- 2025TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoning7 Oct 2025
- 2025Play by the Type Rules: Inferring Constraints for LLM Functions in Declarative Programs24 Sep 2025
- 2025Visual-TableQA: Open-Domain Benchmark for Reasoning over Table Images9 Sep 2025
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information18 Aug 2025
12 newest of 51 All 51 (JSON)
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 50
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
- 2024Researchy Questions: A Dataset of Multi-Perspective, Decompositional Questions for LLM Web Agentscited by 23
- 2024Towards Rationality in Language and Multimodal Agents: A Surveycited by 16
- 2024PreAct: Prediction Enhances Agent's Planning Abilitycited by 12
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflowscited by 11
- 2026WideSeek-R1: Exploring Width Scaling for Broad Information Seeking via Multi-Agent Reinforcement Learningcited by 9
- 2025RAVine: Reality-Aligned Evaluation for Agentic Searchcited by 6
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Modelscited by 5
- 2024A Survey on Complex Tasks for Goal-Directed Interactive Agentscited by 2
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligencecited by 2
12 most cited of 18 All 18 (JSON)
- 2026TableSeek: Structure-Preserving Agentic Evidence Seeking over Heterogeneous Table Corpora28 Sep 2026
- 2026An Actionable Diagnosis of Multilingual, Multi-Agent Planning Failures4 Aug 2026
- 2026Baikal: Structured Search for Deep Research over Data Lakes30 Jul 2026
- 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows29 Jun 2026
- 2026Ko-WideSearch: A Korean Breadth-Search Benchmark for Exhaustive Set Enumeration by Web Agents25 Jun 2026
- 2026IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review23 Apr 2026
- 2026Agentic DAG-Orchestrated Planner Framework for Multi-Modal, Multi-Hop Question Answering in Hybrid Data Lakes15 Mar 2026
- 2026WideSeek-R1: Exploring Width Scaling for Broad Information Seeking via Multi-Agent Reinforcement Learning4 Feb 2026
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models2 Feb 2026
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?27 Oct 2025
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science19 Oct 2025
- 2025RAVine: Reality-Aligned Evaluation for Agentic Search22 Jul 2025
12 newest of 18 All 18 (JSON)
- 2024CompAct: Compressing Retrieved Documents Actively for Question Answeringcited by 64
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2024UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysiscited by 40
- 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularitiescited by 20
- 2025RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarkingcited by 18
- 2022End-to-End Table Question Answering via Retrieval-Augmented Generationcited by 14
- 2024Synthetic Multimodal Question Generationcited by 8
- 2024WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphscited by 6
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphscited by 5
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generationcited by 3
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documentscited by 2
- 2025CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generationcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs28 Jul 2026
- 2026Semantically Similar, Logically Distinct: Diagnosing the Semantic-Answerability Gap in Table RAG20 Jul 2026
- 2026Query Symbolically or Retrieve Semantically? A Dataset and Method for Semi-Structured Question Answering26 May 2026
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documents2 Apr 2026
- 2025RELOOP: Recursive Retrieval with Multi-Hop Reasoner and Planners for Heterogeneous QA23 Oct 2025
- 2025Meet Your New Client: Writing Reports for AI -- Benchmarking Information Loss in Market Research Deliverables17 Aug 2025
- 2025CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation5 Aug 2025
- 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generation4 Jun 2025
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs16 May 2025
- 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities29 Apr 2025
- 2025RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking2 Apr 2025
- 2024WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs14 Aug 2024
12 newest of 17 All 17 (JSON)
- 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tablescited by 13
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMscited by 1
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables13 Jun 2025
- 2024TableGPT2: A Large Multimodal Model with Tabular Data Integration4 Nov 2024
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2022UL2: Unifying Language Learning Paradigmscited by 295
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2021FeTaQA: Free-form Table Question Answeringcited by 175
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
- 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 137
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
- 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
12 most cited of 172 All 172 (JSON)
- 2026Structured Composition of Verifiable Atomic Insights for Table-to-Report Generation2 Oct 2026
- 2026When Harness Beats Scale, and When Reading Beats Both28 Sep 2026
- 2026ORCA: Evaluating LLMs on Data Science Code Translation25 Sep 2026
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026CIPHER: Benchmarking Cross-record Inference over Privacy-Hardened Evidence Records7 Sep 2026
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering31 Aug 2026
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces4 Aug 2026
- 2026WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing28 Jul 2026
- 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes14 Jul 2026
- 2026GDP.pdf: Benchmarking Grounded Multimodal Reasoning over Professional PDF Documents13 Jul 2026
- 2026CODA-BENCH: Can Code Agents Handle Data-Intensive Tasks?13 Jun 2026
12 newest of 172 All 172 (JSON)