e-SNLI-VE: Corrected Visual-Textual Entailment with Natural Language Explanations
Not on the map. Why?
Abstract (arXiv)
The recently proposed SNLI-VE corpus for recognising visual-textual entailment is a large, real-world dataset for fine-grained multimodal reasoning. However, the automatic way in which SNLI-VE has been assembled (via combining parts of two related datasets) gives rise to a large number of errors in the labels of this corpus. In this paper, we first present a data collection effort to correct the class with the highest error rate in SNLI-VE. Secondly, we re-evaluate an existing model on the corrected corpus, which we call SNLI-VE-2.0, and provide a quantitative comparison with its performance on the non-corrected corpus. Thirdly, we introduce e-SNLI-VE, which appends human-written natural language explanations to SNLI-VE-2.0. Finally, we train models that learn from these explanations at training time, and output such explanations at testing time.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 6; 2024: 6; 2025: 3; 2026: 5.
30 papers.
Sort:
By area:
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2022NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Taskscited by 60
- 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 39
- 2021On the Diversity and Limits of Human Explanationscited by 30
- 2024TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoningcited by 12
- 2022A survey on knowledge-enhanced multimodal learningcited by 11
- 2023A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Cluescited by 11
- 2022FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationalescited by 10
- 2022GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-trainingcited by 10
18 more
- 2023Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyondcited by 7
- 2024Finetuning CLIP to Reason about Pairwise Differencescited by 6
- 2026Visual Jev: Accurate and Efficient Decisions from Shared Visual Contextcited by 6
- 2023Understanding and Predicting Human Label Variation in Natural Language Inference through Explanationcited by 5
- 2023From Wrong To Right: A Recursive Approach Towards Vision-Language Explanationcited by 4
- 2025Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanismcited by 4
- 2026BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMscited by 4
- 2024Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignmentcited by 3
- 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Modelscited by 2
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanationscited by 1
- 2021Building a Video-and-Language Dataset with Human Actions for Multimodal Logical Inferencecited by 0
- 2022Accountable and Explainable Methods for Complex Reasoning over Textcited by 0
- 2024VEglue: Testing Visual Entailment Systems via Object-Aligned Joint Erasingcited by 0
- 2025Don't Learn, Ground: A Case for Natural Language Inference with Visual Groundingcited by 0
- 2025CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanationcited by 0
- 2026WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classificationcited by 0
- 2026Towards reliable multimodal disaster severity assessment through preference optimization and explainable vision-language reasoningcited by 0
- 2026Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventionscited by 0
- 2026Visual Jev: Accurate and Efficient Decisions from Shared Visual Context22 Sep 2026
- 2026Towards reliable multimodal disaster severity assessment through preference optimization and explainable vision-language reasoning1 Sep 2026
- 2026Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventions26 Aug 2026
- 2026BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs2 Apr 2026
- 2026WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classification19 Mar 2026
- 2025CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanation7 Dec 2025
- 2025Don't Learn, Ground: A Case for Natural Language Inference with Visual Grounding21 Nov 2025
- 2025Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanism15 Oct 2025
- 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models23 Sep 2024
- 2024Finetuning CLIP to Reason about Pairwise Differences15 Sep 2024
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models8 Jun 2024
- 2024VEglue: Testing Visual Entailment Systems via Object-Aligned Joint Erasing5 Mar 2024
18 more
- 2024TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning29 Feb 2024
- 2024Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment21 Feb 2024
- 2023From Wrong To Right: A Recursive Approach Towards Vision-Language Explanation21 Nov 2023
- 2023Large Language Models are Visual Reasoning Coordinators23 Oct 2023
- 2023Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond23 Oct 2023
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanations30 Sep 2023
- 2023A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues8 May 2023
- 2023Understanding and Predicting Human Label Variation in Natural Language Inference through Explanation24 Apr 2023
- 2022A survey on knowledge-enhanced multimodal learning19 Nov 2022
- 2022Accountable and Explainable Methods for Complex Reasoning over Text9 Nov 2022
- 2022GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training8 Aug 2022
- 2022FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationales2 Jul 2022
- 2022NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks9 Mar 2022
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation28 Jan 2022
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillation16 Jul 2021
- 2021Building a Video-and-Language Dataset with Human Actions for Multimodal Logical Inference27 Jun 2021
- 2021On the Diversity and Limits of Human Explanations22 Jun 2021
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing24 Feb 2021
- 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
- 2024TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoningcited by 12
- 2023A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Cluescited by 11
- 2024Finetuning CLIP to Reason about Pairwise Differencescited by 6
- 2023From Wrong To Right: A Recursive Approach Towards Vision-Language Explanationcited by 4
- 2025Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanismcited by 4
- 2024VEglue: Testing Visual Entailment Systems via Object-Aligned Joint Erasingcited by 0
- 2026Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventionscited by 0
- 2026Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventions26 Aug 2026
- 2025Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanism15 Oct 2025
- 2024Finetuning CLIP to Reason about Pairwise Differences15 Sep 2024
- 2024VEglue: Testing Visual Entailment Systems via Object-Aligned Joint Erasing5 Mar 2024
- 2024TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning29 Feb 2024
- 2023From Wrong To Right: A Recursive Approach Towards Vision-Language Explanation21 Nov 2023
- 2023Large Language Models are Visual Reasoning Coordinators23 Oct 2023
- 2023A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues8 May 2023
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Modelscited by 39
- 2024Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignmentcited by 3
- 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Modelscited by 2
- 2024Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models23 Sep 2024
- 2024One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models8 Jun 2024
- 2024Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment21 Feb 2024
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation28 Jan 2022
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2022NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Taskscited by 60
- 2021On the Diversity and Limits of Human Explanationscited by 30
- 2022A survey on knowledge-enhanced multimodal learningcited by 11
- 2022FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationalescited by 10
- 2022GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-trainingcited by 10
- 2023Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyondcited by 7
- 2026Visual Jev: Accurate and Efficient Decisions from Shared Visual Contextcited by 6
- 2023Understanding and Predicting Human Label Variation in Natural Language Inference through Explanationcited by 5
- 2026BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMscited by 4
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanationscited by 1
12 most cited of 17 All 17 (JSON)
- 2026Visual Jev: Accurate and Efficient Decisions from Shared Visual Context22 Sep 2026
- 2026BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs2 Apr 2026
- 2026WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classification19 Mar 2026
- 2025CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanation7 Dec 2025
- 2025Don't Learn, Ground: A Case for Natural Language Inference with Visual Grounding21 Nov 2025
- 2023Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond23 Oct 2023
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanations30 Sep 2023
- 2023Understanding and Predicting Human Label Variation in Natural Language Inference through Explanation24 Apr 2023
- 2022A survey on knowledge-enhanced multimodal learning19 Nov 2022
- 2022Accountable and Explainable Methods for Complex Reasoning over Text9 Nov 2022
- 2022GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training8 Aug 2022
- 2022FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationales2 Jul 2022
12 newest of 17 All 17 (JSON)