mlsanityData to 14 Oct 2026

VCU-Bridge: Hierarchical Visual Connotation Understanding via Semantic Bridging

arXiv 2511.18121 ↗First posted 22 Nov 2025cs.CV cs.AIcited by 2

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

While Multimodal Large Language Models (MLLMs) excel on benchmarks, their processing paradigm differs from the human ability to integrate visual information. Unlike humans who naturally bridge details and high-level concepts, models tend to treat these elements in isolation. Prevailing evaluation protocols often decouple low-level perception from high-level reasoning, overlooking their semantic and causal dependencies, which yields non-diagnostic results and obscures performance bottlenecks. We present VCU-Bridge, a framework that operationalizes a human-like hierarchy of visual connotation understanding: multi-level reasoning that advances from foundational perception through semantic bridging to abstract connotation, with an explicit evidence-to-inference trace from concrete cues to abstract conclusions. Building on this framework, we construct HVCU-Bench, a benchmark for hierarchical visual connotation understanding with explicit, level-wise diagnostics. Comprehensive experiments demonstrate a consistent decline in performance as reasoning progresses to higher levels. We further develop a data generation pipeline for instruction tuning guided by Monte Carlo Tree Search (MCTS) and show that strengthening low-level capabilities yields measurable gains at higher levels. Interestingly, it not only improves on HVCU-Bench but also brings benefits on general benchmarks (average +2.53%), especially with substantial gains on MMStar (+7.26%), demonstrating the significance of the hierarchical thinking pattern and its effectiveness in enhancing MLLM capabilities. The project page is at https://vcu-bridge.github.io .

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 44 of its 51 references that are in the map. First posted on arXiv 22 Nov 2025.

Builds on

44 of 51 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Socratic-MCTS: Test-Time Visual Reasoning by Asking the Right Questions10 Jun
  2. 2025InsightVision: A Comprehensive, Multi-Level Chinese-based Benchmark for Evaluating Implicit Visual Semantics in Large Vision Language Models19 Feb
  3. 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Model18 Nov
  4. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?29 Mar
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug

Other references · 39

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  8. 2015VQA: Visual Question Answeringcited by 2,506
  9. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  11. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  12. 2025Gemma 3 Technical Reportcited by 1,824
27 more
  1. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  4. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  5. 2024Phi-4 Technical Reportcited by 711
  6. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  7. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  8. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  9. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  10. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  11. 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
  12. 2024Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image Sequencescited by 94
  13. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  14. 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 51
  15. 2024LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Modelcited by 44
  16. 2025MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMscited by 33
  17. 2023MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriacited by 27
  18. 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
  19. 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Modelscited by 16
  20. 2025EEmo-Bench: A Benchmark for Multi-modal Large Language Models on Image Evoked Emotion Assessmentcited by 15
  21. 2025Enhancing Reasoning through Process Supervision with Monte Carlo Tree Searchcited by 14
  22. 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
  23. 2024MVP-Bench: Can Large Vision--Language Models Conduct Multi-level Visual Perception Like Humans?cited by 9
  24. 2025LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Modelscited by 9
  25. 2025VER-Bench: Evaluating MLLMs on Reasoning with Fine-Grained Visual Evidencecited by 9
  26. 2024LIME: Less Is More for MLLM Evaluationcited by 7
  27. 2025Re-ranking Reasoning Context with Tree Search Makes Large Vision-Language Models Strongercited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  2. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
  3. 2025VKnowU: Evaluating Visual Knowledge Understanding in Multimodal LLMs
  4. 2025VisuRiddles: Fine-grained Perception is a Primary Bottleneck for Multimodal Large Language Models in Abstract Visual Reasoning
  5. 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
  6. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  7. 2025Visual Room 2.0: Seeing is Not Understanding for MLLMs
  8. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens