Exploring MLLMs Perception of Network Visualization Principles
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
In this paper, we test whether Multimodal Large Language Models (MLLMs) can match human-subject performance in tasks involving the perception of properties in network layouts. Specifically, we replicate a human-subject experiment about perceiving quality (namely stress) in network layouts using GPT-4o, Gemini-2.5 and Qwen2.5. Our experiments show that giving MLLMs the same study information as trained human participants yields performance comparable to that of human experts and exceeds that of untrained non-experts. Additionally, we show that prompt engineering that deviates from the human-subject experiment can lead to better-than-human performance in some settings. Interestingly, like human subjects, the MLLMs seem to rely on visual proxies rather than computing the actual value of stress, indicating some sense or facsimile of perception. Explanations from the models are similar to those used by the human participants (e.g., an even distribution of nodes and uniform edge lengths).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 17 Jun 2025.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating Graphical Perception with Multimodal LLMs
- 2025Visual Room 2.0: Seeing is Not Understanding for MLLMs
- 2025I Spy With My Model's Eye: Visual Search as a Behavioural Test for MLLMs
- 2026Human-Like Attention? A Psychophysical Comparison of Visual Search in Humans and MLLMs
- 2025The Perceptual Observatory Characterizing Robustness and Grounding in MLLMs
- 2026Do MLLMs See What We See? Analyzing Visualization Literacy Barriers in AI Systems
- 2025Visualization Biases MLLM's Decision Making in Network Data Tasks
- 2025The Plot Thickens: Quantitative Part-by-Part Exploration of MLLM Visualization Literacy