Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chains
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical information scattered across complex visual features. In this work, we propose Focus-Centric Visual Chain, a novel paradigm that enhances VLMs'perception, comprehension, and reasoning abilities in multi-image scenarios. To facilitate this paradigm, we propose Focus-Centric Data Synthesis, a scalable bottom-up approach for synthesizing high-quality data with elaborate reasoning paths. Through this approach, We construct VISC-150K, a large-scale dataset with reasoning data in the form of Focus-Centric Visual Chain, specifically designed for multi-image tasks. Experimental results on seven multi-image benchmarks demonstrate that our method achieves average performance gains of 3.16% and 2.24% across two distinct model architectures, without compromising the general vision-language capabilities. our study represents a significant step toward more robust and capable vision-language systems that can handle complex visual scenarios.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 41 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
26 of 41 references.
Closest ancestors · 7
Same direction, newest first
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Understanding the Limits of Vision Language Models Through the Lens of the Binding Problem31 Oct
- 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis28 Jun
- 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning18 Jun
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the World26 Jun
Other references · 19
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
7 more
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 178
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2024From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake Newscited by 51
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
- 2024The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agentscited by 24
- 2022Perception Over Time: Temporal Dynamics for Robust Image Understandingcited by 2
Built on by
Citing papers per year: 2025: 6; 2026: 5.
11 papers.
- 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake Newscited by 29
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Modelscited by 26
- 2026TTCS: Test-Time Curriculum Synthesis for Self-Evolvingcited by 15
- 2025PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoningcited by 11
- 2025ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Modelcited by 11
- 2025MiCo: Multi-image Contrast for Reinforcement Visual Reasoningcited by 9
- 2026Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energycited by 2
- 2025Mitigating Cross-Image Information Leakage in Multi-Image Understanding with Large Vision-Language Modelscited by 1
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
- 2026Mimic Human Cognition, Master Multi-Image Reasoning: A Meta-Action Framework for Enhanced Visual Understandingcited by 0
- 2026BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generationcited by 0
- 2026BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generation9 Sep 2026
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energy6 Mar 2026
- 2026TTCS: Test-Time Curriculum Synthesis for Self-Evolving30 Jan 2026
- 2026Mimic Human Cognition, Master Multi-Image Reasoning: A Meta-Action Framework for Enhanced Visual Understanding12 Jan 2026
- 2025ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Model28 Oct 2025
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models29 Sep 2025
- 2025Mitigating Cross-Image Information Leakage in Multi-Image Understanding with Large Vision-Language Models19 Aug 2025
- 2025MiCo: Multi-image Contrast for Reinforcement Visual Reasoning27 Jun 2025
- 2025PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning17 Jun 2025
- 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake News13 May 2025
Similar, not cited
Close in wording, no citation either way
- 2023Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding
- 2024Enhancing Advanced Visual Reasoning Ability of Large Language Models
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs
- 2026Not All Error Yields to Scale: Where Scaling Stops in Vision-Language Inference
- 2025VisChainBench: A Benchmark for Multi-Turn, Multi-Image Visual Reasoning Beyond Language Priors
- 2025VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs
- 2025VGR: Visual Grounded Reasoning