Open Question Answering over Tables and Text
Not on the map. Why?
Cited by 27 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In open question answering (QA), the answer to a question is produced by retrieving and then analyzing documents that might contain answers to the question. Most open QA systems have considered only retrieving information from unstructured text. Here we consider for the first time open QA over both tabular and textual data and present a new large-scale dataset Open Table-and-Text Question Answering (OTT-QA) to evaluate performance on this task. Most questions in OTT-QA require multi-hop inference across tabular data and unstructured text, and the evidence required to answer a question can be distributed in different ways over these two types of input, making evidence retrieval challenging -- our baseline model using an iterative retriever and BERT-based reader achieves an exact match score less than 10%. We then propose two novel techniques to address the challenge of retrieving and aggregating evidence for OTT-QA. The first technique is to use "early fusion" to group multiple highly relevant tabular and textual units into a fused block, which provides more context for the retriever to search for. The second technique is to use a cross-block reader to model the cross-dependency between multiple retrieved evidence with global-local sparse attention. Combining these two techniques improves the score significantly, to above 27%.
Key facts. Cited by 163 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 28; 2023: 26; 2024: 35; 2025: 26; 2026: 29.
163 papers.
Sort:
By area:
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 177
- 2021FeTaQA: Free-form Table Question Answeringcited by 174
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2024TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarioscited by 76
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
38 more
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2021MATE: Multi-view Attention for Table Transformer Efficiencycited by 54
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2022A Survey on Table Question Answering: Recent Advancescited by 41
- 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023Rethinking Tabular Data Understanding with Large Language Modelscited by 34
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2021Open Domain Question Answering with A Unified Knowledge Interfacecited by 32
- 2022HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Datacited by 28
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
- 2024Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrievalcited by 27
- 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 26
- 2021Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answeringcited by 25
- 2023IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositionscited by 25
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answeringcited by 25
- 2024OpenTab: Advancing Large Language Models as Open-domain Table Reasonerscited by 25
- 2021Retrieving Complex Tables with Multi-Granular Graph Representation Learningcited by 24
- 2024Exploring the Impact of Table-to-Text Methods on Augmenting LLM-based Question Answering with Domain Hybrid Datacited by 24
- 2024BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational Algebracited by 23
- 2021Few-Shot Table-to-Text Generation with Prototype Memorycited by 21
- 2021Towards Open-World Feature Extrapolation: An Inductive Graph Learning Approachcited by 20
- 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Datacited by 19
- 2022Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decodercited by 17
- 2022Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQAcited by 17
- 2023S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answeringcited by 17
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
- 2025TARGET: Benchmarking Table Retrieval for Generative Taskscited by 17
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
50 most cited of 163 All 163 (JSON)
- 2026TableSeek: Structure-Preserving Agentic Evidence Seeking over Heterogeneous Table Corpora28 Sep 2026
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026CIPHER: Benchmarking Cross-record Inference over Privacy-Hardened Evidence Records7 Sep 2026
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering31 Aug 2026
- 2026Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs28 Jul 2026
- 2026WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing28 Jul 2026
- 2026TEmBed-T: A Multi-Dimensional Benchmark for Table-Level Embeddings27 Jul 2026
- 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes14 Jul 2026
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities7 Jul 2026
- 2026A Gradient Perspective on RLVR Stability and Winner Advantage Policy Optimization15 Jun 2026
- 2026CODA-BENCH: Can Code Agents Handle Data-Intensive Tasks?13 Jun 2026
38 more
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?11 Jun 2026
- 2026LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake9 Jun 2026
- 2026TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs8 Jun 2026
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation3 Jun 2026
- 2026Stage-Audit: Auditable Source-Frontier Discovery for Cross-Wiki Tables19 May 2026
- 2026PIPER: Content-Based Table Search via profiling and LLM-Generated Pseudoqueries18 May 2026
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation15 May 2026
- 2026TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understanding6 May 2026
- 2026RaguTeam at SemEval-2026 Task 8: Meno and Friends in a Judge-Orchestrated LLM Ensemble for Faithful Multi-Turn Response Generation6 May 2026
- 2026FollowTable: A Benchmark for Instruction-Following Table Retrieval1 May 2026
- 2026Towards Universal Tabular Embeddings: A Benchmark Across Data Tasks23 Apr 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documents2 Apr 2026
- 2026DataFactory: Collaborative Multi-Agent Framework for Advanced Table Question Answering10 Mar 2026
- 2026SPARTA: Scalable and Principled Benchmark of Tree-Structured Multi-hop QA over Text and Tables26 Feb 2026
- 2026HELIOS: Harmonizing Early Fusion, Late Fusion, and LLM Reasoning for Multi-Granular Table-Text Retrieval25 Feb 2026
- 2026SAGE: Structure Aware Graph Expansion for Retrieval of Heterogeneous Data18 Feb 2026
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation29 Dec 2025
- 2025Error-Driven Prompt Optimization for Arithmetic Reasoning15 Dec 2025
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025DMA: Online RAG Alignment with Human Feedback6 Nov 2025
- 2025Are We Asking the Right Questions? On Ambiguity in Natural Language Queries for Tabular Data Analysis6 Nov 2025
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science19 Oct 2025
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025SCRIBES: Web-Scale Script-Based Semi-Structured Data Extraction with Reinforcement Learning2 Oct 2025
- 2025Granite Embedding R2 Models26 Aug 2025
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts18 Jun 2025
- 2025Multimodal Tabular Reasoning with Privileged Structured Information4 Jun 2025
- 2025TableEval: A Real-World Benchmark for Complex, Multilingual, and Multi-Structured Table Question Answering4 Jun 2025
- 2025Pruning General Large Language Models into Customized Expert Models3 Jun 2025
- 2025TabularMath: Understanding Math Reasoning over Tables with Large Language Models26 May 2025
- 2025Weaver: Interweaving SQL and LLM for Table Reasoning25 May 2025
- 2025CRAFT: Training-Free Cascaded Retrieval for Tabular QA21 May 2025
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs16 May 2025
- 2025TARGET: Benchmarking Table Retrieval for Generative Tasks14 May 2025
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks26 Apr 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
50 newest of 163 All 163 (JSON)
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
- 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
- 2023Rethinking Tabular Data Understanding with Large Language Modelscited by 34
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answeringcited by 25
- 2024OpenTab: Advancing Large Language Models as Open-domain Table Reasonerscited by 25
- 2024BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational Algebracited by 23
- 2024TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Datacited by 19
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2024Equipping Language Models with Tool Use Capability for Tabular Data Analysis in Financecited by 14
- 2025Multimodal Tabular Reasoning with Privileged Structured Informationcited by 14
- 2023STREET: A Multi-Task Structured Reasoning and Explanation Benchmarkcited by 13
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QAcited by 10
12 most cited of 27 All 27 (JSON)
- 2026A Gradient Perspective on RLVR Stability and Winner Advantage Policy Optimization15 Jun 2026
- 2026Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation3 Jun 2026
- 2026SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation15 May 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2026HELIOS: Harmonizing Early Fusion, Late Fusion, and LLM Reasoning for Multi-Granular Table-Text Retrieval25 Feb 2026
- 2025A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation29 Dec 2025
- 2025Error-Driven Prompt Optimization for Arithmetic Reasoning15 Dec 2025
- 2025Multimodal Tabular Reasoning with Privileged Structured Information4 Jun 2025
- 2025TabularMath: Understanding Math Reasoning over Tables with Large Language Models26 May 2025
- 2025Weaver: Interweaving SQL and LLM for Table Reasoning25 May 2025
- 2024FCMR: Robust Evaluation of Financial Cross-Modal Multi-Hop Reasoning17 Dec 2024
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tables22 Jul 2024
12 newest of 27 All 27 (JSON)
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
- 2025Can we Retrieve Everything All at Once? ARM: An Alignment-Oriented LLM-based Retrieval Methodcited by 10
- 2026DataFactory: Collaborative Multi-Agent Framework for Advanced Table Question Answeringcited by 0
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?cited by 0
- 2026TableSeek: Structure-Preserving Agentic Evidence Seeking over Heterogeneous Table Corporacited by 0
- 2026TableSeek: Structure-Preserving Agentic Evidence Seeking over Heterogeneous Table Corpora28 Sep 2026
- 2026SANA: What Matters for QA Agents over Massive Data Lakes?11 Jun 2026
- 2026DataFactory: Collaborative Multi-Agent Framework for Advanced Table Question Answering10 Mar 2026
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science19 Oct 2025
- 2025Can we Retrieve Everything All at Once? ARM: An Alignment-Oriented LLM-based Retrieval Method30 Jan 2025
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversations27 Aug 2024
- 2024On the Multi-turn Instruction Following for Conversational Web Agents23 Feb 2024
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2022End-to-End Table Question Answering via Retrieval-Augmented Generationcited by 12
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphscited by 5
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documentscited by 1
- 2025DMA: Online RAG Alignment with Human Feedbackcited by 0
- 2026SAGE: Structure Aware Graph Expansion for Retrieval of Heterogeneous Datacited by 0
- 2026Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphscited by 0
- 2026Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs28 Jul 2026
- 2026From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documents2 Apr 2026
- 2026SAGE: Structure Aware Graph Expansion for Retrieval of Heterogeneous Data18 Feb 2026
- 2025DMA: Online RAG Alignment with Human Feedback6 Nov 2025
- 2025mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs16 May 2025
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers18 Jun 2024
- 2022End-to-End Table Question Answering via Retrieval-Augmented Generation30 Mar 2022
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 177
- 2021FeTaQA: Free-form Table Question Answeringcited by 174
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2024TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarioscited by 76
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2021MATE: Multi-view Attention for Table Transformer Efficiencycited by 54
12 most cited of 120 All 120 (JSON)
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026CIPHER: Benchmarking Cross-record Inference over Privacy-Hardened Evidence Records7 Sep 2026
- 2026Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines4 Sep 2026
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering31 Aug 2026
- 2026WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing28 Jul 2026
- 2026TEmBed-T: A Multi-Dimensional Benchmark for Table-Level Embeddings27 Jul 2026
- 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes14 Jul 2026
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities7 Jul 2026
- 2026CODA-BENCH: Can Code Agents Handle Data-Intensive Tasks?13 Jun 2026
- 2026LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake9 Jun 2026
- 2026Stage-Audit: Auditable Source-Frontier Discovery for Cross-Wiki Tables19 May 2026
- 2026PIPER: Content-Based Table Search via profiling and LLM-Generated Pseudoqueries18 May 2026
12 newest of 120 All 120 (JSON)