mlsanityData to 14 Oct 2026

Visual Entailment Task for Visually-Grounded Language Learning

arXiv 1811.10582 ↗First posted 26 Nov 2018cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

We introduce a new inference task - Visual Entailment (VE) - which differs from traditional Textual Entailment (TE) tasks whereby a premise is defined by an image, rather than a natural language sentence as in TE tasks. A novel dataset SNLI-VE (publicly available at https://github.com/necla-ml/SNLI-VE) is proposed for VE tasks based on the Stanford Natural Language Inference corpus and Flickr30k. We introduce a differentiable architecture called the Explainable Visual Entailment model (EVE) to tackle the VE problem. EVE and several other state-of-the-art visual question answering (VQA) based models are evaluated on the SNLI-VE dataset, facilitating grounded language understanding and providing insights on how modern VQA based models perform.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 11; 2023: 10; 2024: 9; 2025: 1.

36 papers.

Sort:

By area:

  1. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
  2. 2021Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learningcited by 187
  3. 2022VLP: A Survey on Vision-Language Pre-trainingcited by 159
  4. 2021MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuningcited by 85
  5. 2021Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-trainingcited by 67
  6. 2023PuMer: Pruning and Merging Tokens for Efficient Vision Language Modelscited by 53
  7. 2022MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Modelcited by 41
  8. 2023VideoCon: Robust Video-Language Alignment via Contrast Captionscited by 30
  9. 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Modelscited by 28
  10. 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
  11. 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
  12. 2023Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignmentcited by 18
24 more
  1. 2024A Survey on Quality Metrics for Text-to-Image Generationcited by 18
  2. 2024HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Textscited by 17
  3. 2021SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoningcited by 16
  4. 2022HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Taskscited by 12
  5. 2022A survey on knowledge-enhanced multimodal learningcited by 11
  6. 2024VELOCITI: Benchmarking Video-Language Compositional Reasoning with Strict Entailmentcited by 10
  7. 2023Good Questions Help Zero-Shot Image Reasoningcited by 8
  8. 2023Tackling Vision Language Tasks Through Learning Inner Monologuescited by 7
  9. 2024Transferring Knowledge from Large Foundation Models to Small Downstream Modelscited by 7
  10. 2021MLP Architectures for Vision-and-Language Modeling: An Empirical Studycited by 6
  11. 2022Understanding ME? Multimodal Evaluation for Fine-grained Visual Commonsensecited by 5
  12. 2022AlignVE: Visual Entailment Recognition Based on Alignment Relationscited by 5
  13. 2024MoPE: Mixture of Prompt Experts for Parameter-Efficient and Scalable Multimodal Fusioncited by 5
  14. 20243AM: An Ambiguity-Aware Multi-Modal Machine Translation Datasetcited by 4
  15. 2022Learning More May Not Be Better: Knowledge Transferability in Vision and Language Taskscited by 3
  16. 2023An Empirical Study on the Language Modal in Visual Question Answeringcited by 3
  17. 2023The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challengescited by 2
  18. 2023Artificial-Spiking Hierarchical Networks for Vision-Language Representation Learningcited by 1
  19. 2024Memory-Inspired Temporal Prompt Interaction for Text-Image Classificationcited by 1
  20. 2023Visual Reasoning: from State to Transformationcited by 0
  21. 2023Preconditioned Visual Language Inference with Weak Supervisioncited by 0
  22. 2024VEglue: Testing Visual Entailment Systems via Object-Aligned Joint Erasingcited by 0
  23. 2024Robust Latent Representation Tuning for Image-text Classificationcited by 0
  24. 2025EPIC: Efficient Prompt Interaction for Text-Image Classificationcited by 0