Analyze-Prompt-Reason: A Collaborative Agent-Based Framework for Multi-Image Vision-Language Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based PromptEngineer, which generates context-aware, task-specific prompts, and a VisionReasoner, a large vision-language model (LVLM) responsible for final inference. The framework is fully automated, modular, and training-free, enabling generalization across classification, question answering, and free-form generation tasks involving one or multiple input images. We evaluate our method on 18 diverse datasets from the 2025 MIRAGE Challenge (Track A), covering a broad spectrum of visual reasoning tasks including document QA, visual comparison, dialogue-based understanding, and scene-level inference. Our results demonstrate that LVLMs can effectively reason over multiple images when guided by informative prompts. Notably, Claude 3.7 achieves near-ceiling performance on challenging tasks such as TQA (99.13% accuracy), DocVQA (96.87%), and MMCoQA (75.28 ROUGE-L). We also explore how design choices-such as model selection, shot count, and input length-influence the reasoning performance of different LVLMs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 32 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
21 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2024PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation19 Dec
- 2024Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning18 Jun
Other references · 19
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 858
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 179
- 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 143
- 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
- 2021WebQA: Multihop and Multimodal QAcited by 109
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2019Neural Naturalist: Generating Fine-Grained Image Comparisonscited by 36
7 more
- 2023VISION Datasets: A Benchmark for Vision-based InduStrial InspectiONcited by 25
- 2023iEdit: Localised Text-guided Image Editing with Weak Supervisioncited by 20
- 2019NLVR2 Visual Bias Analysiscited by 19
- 2018Totally Looks Like - How Humans Compare, Compared to Machinescited by 12
- 2018Textbook Question Answering with Multi-modal Context Graph Understanding and Self-supervised Open-set Comprehensioncited by 3
- 2019Robust Change Captioningcited by 2
- 2025Resampling Benchmark for Efficient Comprehensive Evaluation of Large Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Reasoning-Informed Visual Editingcited by 0
- 2026Reasoning-Informed Visual Editing8 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2023Towards Top-Down Reasoning: An Explainable Multi-Agent Approach for Visual Question Answering
- 2025MARIC: Multi-Agent Reasoning for Image Classification
- 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning
- 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
- 2026SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning
- 2026Understanding Multi-Agent Reasoning with Large Language Models for Cartoon VQA
- 2025Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks