mlsanityData to 7 Oct 2026

Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chains

arXiv 2504.20199 ↗First posted 28 Apr 2025cs.CV cs.AI cs.CLcited by 11

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical information scattered across complex visual features. In this work, we propose Focus-Centric Visual Chain, a novel paradigm that enhances VLMs'perception, comprehension, and reasoning abilities in multi-image scenarios. To facilitate this paradigm, we propose Focus-Centric Data Synthesis, a scalable bottom-up approach for synthesizing high-quality data with elaborate reasoning paths. Through this approach, We construct VISC-150K, a large-scale dataset with reasoning data in the form of Focus-Centric Visual Chain, specifically designed for multi-image tasks. Experimental results on seven multi-image benchmarks demonstrate that our method achieves average performance gains of 3.16% and 2.24% across two distinct model architectures, without compromising the general vision-language capabilities. our study represents a significant step toward more robust and capable vision-language systems that can handle complex visual scenarios.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 41 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

26 of 41 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  2. 2024Understanding the Limits of Vision Language Models Through the Lens of the Binding Problem31 Oct
  3. 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis28 Jun
  4. 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning18 Jun
  5. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug
  7. 2023Kosmos-2: Grounding Multimodal Large Language Models to the World26 Jun

Other references · 19

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  5. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  9. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  11. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  12. 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
7 more
  1. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
  2. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 178
  3. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
  4. 2024From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake Newscited by 51
  5. 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
  6. 2024The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agentscited by 24
  7. 2022Perception Over Time: Temporal Dynamics for Robust Image Understandingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding
  2. 2024Enhancing Advanced Visual Reasoning Ability of Large Language Models
  3. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens
  4. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs
  5. 2026Not All Error Yields to Scale: Where Scaling Stops in Vision-Language Inference
  6. 2025VisChainBench: A Benchmark for Multi-Turn, Multi-Image Visual Reasoning Beyond Language Priors
  7. 2025VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs
  8. 2025VGR: Visual Grounded Reasoning