ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is relevant, true, or even meaningful. Recently, it has been identified and given a mechanistic account in unimodal language models. Whether and how it manifests in vision-language models (VLMs) is, by contrast, largely unexamined, and the field lacks a purpose-built instrument with which to investigate it. We take the position that studying contextual entrainment in VLMs requires more than porting an existing text-only benchmark to the multimodal setting: it requires a taxonomically structured, dual-modality instrument whose conditions are constructed around the item at hand (the depicted image in the textual stream, the textual query in the visual stream). We argue that the move to VLMs is substantive rather than incremental. It makes entrainment a dual phenomenon, drivable independently by textual and by visual context, and it opens a veracity distinction (context that is false of the depicted scene yet possible in the world) that has no counterpart in the unimodal, world-knowledge-only formulation of prior work. To make this position concrete and actionable, we introduce ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes, i.e., the association of context with the item and its relationship to truth, and split into a textual-entrainment stream (eight context conditions) and a visual-entrainment stream (three context conditions). We do not claim to measure entrainment in any particular model; we provide the instrument, the taxonomy that motivates it, and the evaluation protocols it enables, so that the community can investigate the phenomenon rigorously. We will release the dataset and its documentation publicly.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 14 of its 22 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
14 of 22 references.
Closest ancestors · 3
Same direction, newest first
- 2026The Expense of Seeing: Attaining Trustworthy Multimodal Reasoning Within the Monolithic Paradigm22 Apr
- 2024Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts24 Jun
- 2024What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Gaussian-Noise-free Text-Image Corruption and Evaluation24 Jun
Other references · 11
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2018Object Hallucination in Image Captioningcited by 661
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 319
- 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 88
- 2024Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMscited by 37
- 2024Context versus Prior Knowledge in Language Modelscited by 25
- 2024Have the VLMs Lost Confidence? A Study of Sycophancy in VLMscited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Probing Vision-Language Understanding through the Visual Entailment Task: promises and pitfalls
- 2026Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models
- 2026Real Images, Worse Judgments: Evaluating Vision-Language Models on Concreteness and Imagery
- 2026Where To Look? : Causal Tracing of Vision Encoders in VLM
- 2026Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts
- 2026I Don't Miss You, but I Do: Self-Explanation Faithfulness of Modality Missingness in Vision-Language Models
- 2026VLMs Need Words: Vision Language Models Ignore Visual Detail In Favor of Semantic Anchors
- 2025MMLongCite: A Benchmark for Evaluating Fidelity of Long-Context Vision-Language Models