INFOTABS: Inference on Tables as Semi-structured Data
Not on the map. Why?
Abstract (arXiv)
In this paper, we observe that semi-structured tabulated text is ubiquitous; understanding them requires not only comprehending the meaning of text fragments, but also implicit relationships between them. We argue that such data can prove as a testing ground for understanding how we reason about information. To study this, we introduce a new dataset called INFOTABS, comprising of human-written textual hypotheses based on premises that are tables extracted from Wikipedia info-boxes. Our analysis shows that the semi-structured, multi-domain and heterogeneous nature of the premises admits complex, multi-faceted reasoning. Experiments reveal that, while human annotators agree on the relationships between a table-hypothesis pair, several standard modeling strategies are unsuccessful at the task, suggesting that reasoning about tables can pose a difficult modeling challenge.
Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 12; 2023: 19; 2024: 14; 2025: 17; 2026: 7.
84 papers.
Sort:
By area:
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
- 2023Self-Knowledge Guided Retrieval Augmentation for Large Language Modelscited by 69
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2024Multimodal Table Understandingcited by 43
38 more
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 41
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
- 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
- 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 34
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2023Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Modelscited by 31
- 2024A Survey of Table Reasoning with Large Language Modelscited by 29
- 2024StructLM: Towards Building Generalist Models for Structured Knowledge Groundingcited by 29
- 2023Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applicationscited by 28
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answeringcited by 25
- 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
- 2021Representations for Question Answering from Documents with Tables and Textcited by 21
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2022DiSCoMaT: Distantly Supervised Composition Extraction from Tables in Materials Science Articlescited by 17
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinementcited by 16
- 2025SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verificationcited by 16
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 15
- 2021TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-trainingcited by 14
- 2025Multimodal Tabular Reasoning with Privileged Structured Informationcited by 14
- 2022Table-based Fact Verification with Self-adaptive Mixture of Expertscited by 12
- 2023Investigating Table-to-Text Generation Capabilities of LLMs in Real-World Information Seeking Scenarioscited by 12
- 2021Dataset of Fake News Detection and Fact Verification: A Surveycited by 11
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2021Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence-Based Tabular Reasoningcited by 9
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
- 2025Weaver: Interweaving SQL and LLM for Table Reasoningcited by 8
- 2021Graph Reasoning with Context-Aware Linearization for Interpretable Fact Extraction and Verificationcited by 6
- 2022Mind the Labels: Describing Relations in Knowledge Graphs With Pretrained Modelscited by 6
- 2022Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Frameworkcited by 6
- 2023Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Setscited by 6
- 2024TANQ: An open domain dataset of table answered questionscited by 6
- 2025HIPPO: Enhancing the Table Understanding Capability of LLMs through Hybrid-Modal Preference Optimizationcited by 5
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understandingcited by 5
- 2021Logic-level Evidence Retrieval and Graph-based Verification Network for Table-based Fact Verificationcited by 4
- 2022Realistic Data Augmentation Framework for Enhancing Tabular Reasoningcited by 4
50 most cited of 84 All 84 (JSON)
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning26 Sep 2026
- 2026V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization22 Apr 2026
- 2026InfiniteScienceGym: An Unbounded, Procedurally-Generated Benchmark for Scientific Analysis14 Apr 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2026How to Utilize Complementary Vision-Text Information for 2D Structure Understanding17 Mar 2026
- 2026Efficient Table Retrieval and Understanding with Multimodal Large Language Models7 Feb 2026
- 2026ClaimDB: A Fact Verification Benchmark over Large Structured Data21 Jan 2026
- 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoning29 Nov 2025
- 2025TabFlash: Efficient Table Understanding with Progressive Question Conditioning and Token Focusing17 Nov 2025
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding25 Sep 2025
38 more
- 2025TableDART: Dynamic Adaptive Multi-Modal Routing for Table Understanding18 Sep 2025
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe16 Sep 2025
- 2025M3TQA: Massively Multilingual Multitask Table Question Answering22 Aug 2025
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification18 Jun 2025
- 2025Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers12 Jun 2025
- 2025TableDreamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning10 Jun 2025
- 2025Multimodal Tabular Reasoning with Privileged Structured Information4 Jun 2025
- 2025Weaver: Interweaving SQL and LLM for Table Reasoning25 May 2025
- 2025HIPPO: Enhancing the Table Understanding Capability of LLMs through Hybrid-Modal Preference Optimization24 Feb 2025
- 2025What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects24 Jan 2025
- 2025Task-Oriented Automatic Fact-Checking with Frame-Semantics23 Jan 2025
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documents8 Nov 2024
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tables22 Jul 2024
- 2024EHRCon: Dataset for Checking Consistency between Unstructured Notes and Structured Tables in Electronic Health Records24 Jun 2024
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers18 Jun 2024
- 2024Multimodal Table Understanding12 Jun 2024
- 2024TANQ: An open domain dataset of table answered questions13 May 2024
- 2024ViWikiFC: Fact-Checking for Vietnamese Wikipedia-Based Textual Knowledge Source13 May 2024
- 2024Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model26 Mar 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2024StructLM: Towards Building Generalist Models for Structured Knowledge Grounding26 Feb 2024
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering17 Feb 2024
- 2024A Survey of Table Reasoning with Large Language Models13 Feb 2024
- 2024Are Large Language Models Table-based Fact-Checkers?4 Feb 2024
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement1 Feb 2024
- 2023Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets15 Nov 2023
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tables14 Nov 2023
- 2023Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications10 Nov 2023
- 2023ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generation27 Oct 2023
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity11 Oct 2023
- 2023Self-Knowledge Guided Retrieval Augmentation for Large Language Models8 Oct 2023
- 2023Effective Distillation of Table-based Reasoning Ability from LLMs22 Sep 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023InfoSync: Information Synchronization across Multilingual Semi-structured Tables6 Jul 2023
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations25 Jun 2023
- 2023FERMAT: An Alternative to Accuracy for Numerical Reasoning27 May 2023
- 2023NLP Reproducibility For All: Understanding Experiences of Beginners26 May 2023
50 newest of 84 All 84 (JSON)
- 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
- 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2024A Survey of Table Reasoning with Large Language Modelscited by 29
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answeringcited by 25
- 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinementcited by 16
- 2025Multimodal Tabular Reasoning with Privileged Structured Informationcited by 14
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tablescited by 8
- 2025Weaver: Interweaving SQL and LLM for Table Reasoningcited by 8
- 2022Enhancing Tabular Reasoning with Pattern Exploiting Trainingcited by 3
12 most cited of 17 All 17 (JSON)
- 2026InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning26 Sep 2026
- 2026V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization22 Apr 2026
- 2026TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables4 Apr 2026
- 2025Evidence-Guided Schema Normalization for Temporal Tabular Reasoning29 Nov 2025
- 2025Multimodal Tabular Reasoning with Privileged Structured Information4 Jun 2025
- 2025Weaver: Interweaving SQL and LLM for Table Reasoning25 May 2025
- 2024Enhancing Temporal Understanding in LLMs for Semi-structured Tables22 Jul 2024
- 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering17 Feb 2024
- 2024A Survey of Table Reasoning with Large Language Models13 Feb 2024
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement1 Feb 2024
- 2023Effective Distillation of Table-based Reasoning Ability from LLMs22 Sep 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
12 newest of 17 All 17 (JSON)
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 15
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
- 2023Self-Knowledge Guided Retrieval Augmentation for Large Language Modelscited by 69
- 2024Multimodal Table Understandingcited by 43
- 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 41
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
- 2022CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checkingcited by 37
- 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
- 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 34
12 most cited of 59 All 59 (JSON)
- 2026InfiniteScienceGym: An Unbounded, Procedurally-Generated Benchmark for Scientific Analysis14 Apr 2026
- 2026How to Utilize Complementary Vision-Text Information for 2D Structure Understanding17 Mar 2026
- 2026ClaimDB: A Fact Verification Benchmark over Large Structured Data21 Jan 2026
- 2025TabFlash: Efficient Table Understanding with Progressive Question Conditioning and Token Focusing17 Nov 2025
- 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation8 Oct 2025
- 2025TABLET: A Large-Scale Dataset for Robust Visual Table Understanding25 Sep 2025
- 2025TableDART: Dynamic Adaptive Multi-Modal Routing for Table Understanding18 Sep 2025
- 2025M3TQA: Massively Multilingual Multitask Table Question Answering22 Aug 2025
- 2025SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification18 Jun 2025
- 2025Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers12 Jun 2025
- 2025What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects24 Jan 2025
- 2025Task-Oriented Automatic Fact-Checking with Frame-Semantics23 Jan 2025
12 newest of 59 All 59 (JSON)