mlsanityData to 14 Oct 2026

See the Forest and the Trees: A Synergistic Reasoning Framework for Knowledge-Based Visual Question Answering

arXiv 2507.17659 ↗First posted 23 Jul 2025cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have pushed the frontiers of Knowledge-Based Visual Question Answering (KBVQA), yet their reasoning is fundamentally bottlenecked by a reliance on uni-dimensional evidence. This "seeing only the trees, but not the forest" approach prevents robust, multi-faceted understanding. Inspired by the principle of seeing both the forest and trees, we propose Synergos-VQA, a novel synergistic reasoning framework. At its core, Synergos-VQA concurrently generates and fuses three complementary evidence streams at inference time: (1) Holistic Evidence to perceive the entire scene (the "forest"), (2) Structural Evidence from a prototype-driven module to identify key objects (the "trees"), and (3) Causal Evidence from a counterfactual probe to ensure the reasoning is robustly grounded. By synergistically fusing this multi-faceted evidence, our framework achieves a more comprehensive and reliable reasoning process. Extensive experiments show that Synergos-VQA decisively establishes a new state-of-the-art on three challenging benchmarks, including OK-VQA and A-OKVQA. Furthermore, our approach demonstrates strong plug-and-play capabilities, significantly boosting various open-source MLLMs and proving that superior methodological design can outperform sheer model scale.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 2 of its 44 references that are in the map. First posted on arXiv 23 Jul 2025.

Builds on

2 of 44 references.

References · 2

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2022Prompting through Prototype: A Prototype-based Prompt Learning on Pretrained Vision-Language Modelscited by 12

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA
  2. 2024Find The Gap: Knowledge Base Reasoning For Visual Question Answering
  3. 2025StaR-KVQA: Structured Reasoning Traces for Implicit-Knowledge Visual Question Answering
  4. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
  5. 2026MaS-VQA: A Mask-and-Select Framework for Knowledge-Based Visual Question Answering
  6. 2024Knowledge Condensation and Reasoning for Knowledge-based VQA
  7. 2026M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering
  8. 2025MAGIC-VQA: Multimodal And Grounded Inference with Commonsense Knowledge for Visual Question Answering