GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse vision-language tasks, creating an urgent need for more challenging benchmarks. Yet existing evaluations still provide limited insight into whether these models can truly reason over structured visual information. Visual Graph Reasoning (VGR) offers a compelling testbed for this challenge, requiring models to integrate perception, structural understanding, and multi-step reasoning over graph-based visual inputs. However, prior VGR benchmarks often reduce the task to visual perception followed by text-based reasoning, restrict evaluation to single-image settings, rely on answer-only metrics, and underrepresent realistic graph-centric scenarios. To bridge the gap, we introduce GraphVerse, a unified benchmark that jointly evaluates perception, visual reasoning, and text-based graph reasoning in MLLMs under both single-image and paired-image settings. At its core is a suite of Graph-centric Image Editing (GIE) strategies that modify graph images while preserving their semantics, turning them into active tests of visual reasoning. We further propose VGR-Score, a process-sensitive metric that evaluates reasoning quality beyond final-answer accuracy. Extensive experiments reveal several key limitations of current MLLMs in VGR, while also validating the effectiveness of GIE strategies and the transferability of GraphVerse to broader multimodal reasoning capabilities. The code is available at https://github.com/sunyuanfu/GraphVerse.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 57 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
27 of 57 references.
Closest ancestors · 8
Same direction, newest first
- 2026Mario: Multimodal Graph Reasoning with Large Language Models5 Mar
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs27 May
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024VisionGraph: Leveraging Large Multimodal Models for Graph Theory Problems in Visual Context8 May
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 19
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
7 more
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
- 2025Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimizationcited by 14
- 2025MITS: Enhanced Tree Search Reasoning for LLMs via Pointwise Mutual Informationcited by 8
- 2025Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Modelscited by 3
- 2026One Model, Many Graphs: Learning over Attributed Graphs across Heterogeneous Modalities with Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Scene Graph Thinking: Reinforcing Structured Visual Reasoning for Multimodal Large Language Models
- 2025Graph-to-Vision: Multi-graph Understanding and Reasoning using Vision-Language Models
- 2024Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2024VisGraphVar: A Benchmark Generator for Assessing Variability in Graph Analysis Using Large Vision-Language Models
- 2025VGR: Visual Grounded Reasoning
- 2024GITA: Graph to Visual and Textual Integration for Vision-Language Graph Reasoning
- 2025VisualQuest: A Benchmark for Abstract Visual Reasoning in MLLMs