Realistic Data Augmentation Framework for Enhancing Tabular Reasoning
Not on the map. Why?
Abstract (arXiv)
Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully automatic methods. However, the former is expensive and time-consuming and thus limits scale, and the latter often produces naive examples that may lack complex reasoning. This paper develops a realistic semi-automated framework for data augmentation for tabular inference. Instead of manually generating a hypothesis for each table, our methodology generates hypothesis templates transferable to similar tables. In addition, our framework entails the creation of rational counterfactual tables based on human written logical constraints and premise paraphrasing. For our case study, we use the InfoTabs, which is an entity-centric tabular inference dataset. We observed that our framework could generate human-like tabular inference examples, which could benefit training data augmentation, especially in the scenario with limited supervision.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 51 of its 65 references that are in the map. First posted on arXiv 23 Oct 2022.
Builds on
51 of 65 references.
References · 51
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2018Annotation Artifacts in Natural Language Inference Datacited by 656
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
38 more
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
- 2018SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inferencecited by 333
- 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 310
- 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
- 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
- 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 212
- 2018Stress Test Evaluation for Natural Language Inferencecited by 211
- 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 173
- 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
- 2020Open Question Answering over Tables and Textcited by 163
- 2020DART: Open-Domain Structured Data Record to Text Generationcited by 144
- 2018Breaking NLI Systems with Sentences that Require Simple Lexical Inferencescited by 134
- 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
- 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
- 2019Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Modelcited by 102
- 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
- 2022TableFormer: Robust Transformer Modeling for Table-Text Encodingcited by 90
- 2020INFOTABS: Inference on Tables as Semi-structured Datacited by 84
- 2020Understanding tables with intermediate pre-trainingcited by 68
- 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
- 2020UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answeringcited by 61
- 2020Logic2Text: High-Fidelity Natural Language Generation from Logical Formscited by 45
- 2021Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skillscited by 39
- 2019Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrievalcited by 37
- 2021Capturing Row and Column Semantics in Transformer Based Question Answering over Tablescited by 31
- 2018Analyzing Compositionality-Sensitivity of NLI Modelscited by 26
- 2022StruBERT: Structure-aware BERT for Table Search and Matchingcited by 24
- 2021Incorporating External Knowledge to Enhance Tabular Reasoningcited by 23
- 2019Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasetscited by 21
- 2021Representations for Question Answering from Documents with Tables and Textcited by 21
- 2020Summarizing and Exploring Tabular Data in Conversational Searchcited by 19
- 2021TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-trainingcited by 14
- 2021Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence-Based Tabular Reasoningcited by 9
- 2021LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Frameworkcited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tablescited by 27
- 2024Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloudcited by 4
- 2024Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud6 Dec 2024
- 2024Demystifying Chains, Trees, and Graphs of Thoughts25 Jan 2024
- 2023TempTabQA: Temporal Question Answering for Semi-Structured Tables14 Nov 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023