Transforming Question Answering Datasets Into Natural Language Inference Datasets
Not on the map. Why?
Abstract (arXiv)
Existing datasets for natural language inference (NLI) have propelled research on language understanding. We propose a new method for automatically deriving NLI datasets from the growing abundance of large-scale question answering datasets. Our approach hinges on learning a sentence transformation model which converts question-answer pairs into their declarative forms. Despite being primarily trained on a single QA dataset, we show that it can be successfully applied to a variety of other QA resources. Using this system, we automatically derive a new freely available dataset of over 500k NLI examples (QA-NLI), and show that it exhibits a wide range of inference phenomena rarely seen in previous NLI datasets.
Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 24; 2023: 29; 2024: 16; 2025: 10; 2026: 2.
99 papers.
Sort:
By area:
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2022Memory-Based Model Editing at Scalecited by 443
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 233
- 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 176
- 2021Explaining Answers with Entailment Treescited by 148
- 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
- 2022CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailmentcited by 113
- 2023Task Contamination: Language Models May Not Be Few-Shot Anymorecited by 98
- 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
- 2021Multi-Modal Answer Validation for Knowledge-Based VQAcited by 78
- 2021DocNLI: A Large-scale Dataset for Document-level Natural Language Inferencecited by 75
38 more
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
- 2021Can NLI Models Verify QA Systems' Predictions?cited by 46
- 2021Zero-shot Fact Verification by Claim Generationcited by 42
- 2022Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inferencecited by 40
- 2022Entailer: Answering Questions with Faithful and Truthful Chains of Reasoningcited by 38
- 2022Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvementcited by 37
- 2024Advancing Parameter Efficiency in Fine-tuning via Representation Editingcited by 37
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2022Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarizationcited by 34
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Datacited by 33
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2023NevIR: Negation in Neural Information Retrievalcited by 28
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2022Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric Summarizationcited by 26
- 2023Zero-shot Faithful Factual Error Correctioncited by 26
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
- 2024HyperMoE: Towards Better Mixture of Experts via Transferring Among Expertscited by 25
- 2022REV: Information-Theoretic Evaluation of Free-Text Rationalescited by 22
- 2024MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimizationcited by 20
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2021Hybrid Autoregressive Inference for Scalable Multi-hop Explanation Regenerationcited by 17
- 2022OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Modelscited by 17
- 2022NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoningcited by 16
- 2025ARGUS: Hallucination and Omission Evaluation in Video-LLMscited by 16
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
- 2022Shortcomings of Question Answering Based Factuality Frameworks for Error Localizationcited by 15
- 2023Language Models with Rationalitycited by 15
- 2023Selective Generation for Controllable Language Modelscited by 15
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Modelscited by 13
- 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logiccited by 12
- 2024Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Taskscited by 12
- 2024Accurate and Nuanced Open-QA Evaluation Through Textual Entailmentcited by 12
- 2023TaskWeb: Selecting Better Source Tasks for Multi-task NLPcited by 11
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
- 2021Semantically Distributed Robust Optimization for Vision-and-Language Inferencecited by 9
- 2022Model ensemble instead of prompt fusion: a sample-specific knowledge transfer method for few-shot prompt tuningcited by 9
- 2022Ask to Know More: Generating Counterfactual Explanations for Fake Claimscited by 8
- 2023Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphscited by 8
50 most cited of 99 All 99 (JSON)
- 2026How Correct Is Your Answer? A Semantic Correctness Framework for Open QA Evaluation1 Sep 2026
- 2026Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions12 Apr 2026
- 2025MERGE: Minimal Expression-Replacement GEneralization Test for Natural Language Inference28 Oct 2025
- 2025Memory Constrained Dynamic Subnetwork Update for Transfer Learning23 Oct 2025
- 2025Study of Training Dynamics for Memory-Constrained Fine-Tuning22 Oct 2025
- 2025DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge19 Oct 2025
- 2025Quantum NLP models on Natural Language Inference12 Oct 2025
- 2025Vanishing Contributions: A Unified Framework for Smooth and Iterative Model Compression9 Oct 2025
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning10 Jun 2025
- 2025ARGUS: Hallucination and Omission Evaluation in Video-LLMs9 Jun 2025
- 2025Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning23 Mar 2025
- 2025PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization11 Mar 2025
38 more
- 2024Momentum Posterior Regularization for Multi-hop Dense Retrieval17 Dec 2024
- 2024Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 20248 Nov 2024
- 2024BQA: Body Language Question Answering Dataset for Video Large Language Models17 Oct 2024
- 2024ACCEPT: Adaptive Codebook for Composite and Efficient Prompt Tuning10 Oct 2024
- 2024How Hard is this Test Set? NLI Characterization by Exploiting Training Dynamics4 Oct 2024
- 2024MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization4 Jul 2024
- 2024GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory18 Jun 2024
- 2024Document-level Claim Extraction and Decontextualisation for Fact-Checking5 Jun 2024
- 2024Accurate and Nuanced Open-QA Evaluation Through Textual Entailment26 May 2024
- 2024Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Tasks24 Apr 2024
- 2024Robust and Scalable Model Editing for Large Language Models26 Mar 2024
- 2024Advancing Parameter Efficiency in Fine-tuning via Representation Editing23 Feb 2024
- 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning23 Feb 2024
- 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic22 Feb 2024
- 2024HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts20 Feb 2024
- 2024Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning13 Feb 2024
- 2023Task Contamination: Language Models May Not Be Few-Shot Anymore26 Dec 2023
- 2023Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs19 Dec 2023
- 2023Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language15 Dec 2023
- 2023RDR: the Recap, Deliberate, and Respond Method for Enhanced Language Understanding15 Dec 2023
- 2023A Bayesian approach for prompt optimization in pre-trained language models1 Dec 2023
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Data3 Nov 2023
- 2023BabyStories: Can Reinforcement Learning Teach Baby Language Models to Write Better Stories?25 Oct 2023
- 2023Diversity Enhanced Narrative Question Generation for Storybooks25 Oct 2023
- 2023Ask To The Point: Open-Domain Entity-Centric Question Generation21 Oct 2023
- 2023Prototype-based HyperAdapter for Sample-Efficient Multi-task Tuning18 Oct 2023
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Models13 Oct 2023
- 2023No that's not what I meant: Handling Third Position Repair in Conversational Question Answering31 Jul 2023
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul 2023
- 2023Selective Generation for Controllable Language Models18 Jul 2023
- 2023CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity and Infant Care4 Jul 2023
- 2023IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning27 Jun 2023
- 2023SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoning21 Jun 2023
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference16 Jun 2023
- 2023FERMAT: An Alternative to Accuracy for Numerical Reasoning27 May 2023
- 2023Modularized Zero-shot VQA with Pre-trained Models27 May 2023
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Function26 May 2023
- 2023Language Models with Rationality23 May 2023
50 newest of 99 All 99 (JSON)
- 2022Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvementcited by 37
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Datacited by 33
- 2022NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoningcited by 16
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Modelscited by 13
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inferencecited by 4
- 2023FERMAT: An Alternative to Accuracy for Numerical Reasoningcited by 3
- 2023SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoningcited by 3
- 2023IDOL: Indicator-oriented Logic Pre-training for Logical Reasoningcited by 3
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Data3 Nov 2023
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Models13 Oct 2023
- 2023IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning27 Jun 2023
- 2023SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoning21 Jun 2023
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference16 Jun 2023
- 2023FERMAT: An Alternative to Accuracy for Numerical Reasoning27 May 2023
- 2022NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoning16 Sep 2022
- 2022Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement27 Apr 2022
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2022Memory-Based Model Editing at Scalecited by 443
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 233
- 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 176
- 2021Explaining Answers with Entailment Treescited by 148
- 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
- 2022CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailmentcited by 113
- 2023Task Contamination: Language Models May Not Be Few-Shot Anymorecited by 98
- 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
- 2021Multi-Modal Answer Validation for Knowledge-Based VQAcited by 78
- 2021DocNLI: A Large-scale Dataset for Document-level Natural Language Inferencecited by 75
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
12 most cited of 85 All 85 (JSON)
- 2026How Correct Is Your Answer? A Semantic Correctness Framework for Open QA Evaluation1 Sep 2026
- 2026Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions12 Apr 2026
- 2025MERGE: Minimal Expression-Replacement GEneralization Test for Natural Language Inference28 Oct 2025
- 2025Memory Constrained Dynamic Subnetwork Update for Transfer Learning23 Oct 2025
- 2025Study of Training Dynamics for Memory-Constrained Fine-Tuning22 Oct 2025
- 2025DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge19 Oct 2025
- 2025Quantum NLP models on Natural Language Inference12 Oct 2025
- 2025Vanishing Contributions: A Unified Framework for Smooth and Iterative Model Compression9 Oct 2025
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning10 Jun 2025
- 2025ARGUS: Hallucination and Omission Evaluation in Video-LLMs9 Jun 2025
- 2025Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning23 Mar 2025
- 2024Momentum Posterior Regularization for Multi-hop Dense Retrieval17 Dec 2024
12 newest of 85 All 85 (JSON)