mlsanityData to 14 Oct 2026

ViStruct: Simulating Expert-Like Reasoning Through Task Decomposition and Visual Attention Cues

arXiv 2506.21762 ↗First posted 26 Jun 2025cs.HCcited by 1

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Data visualization tasks often require multi-step reasoning, and the interpretive strategies experts use, such as decomposing complex goals into smaller subtasks and selectively attending to key chart regions are rarely made explicit. ViStruct is an automated pipeline that simulates these expert behaviours by breaking high-level visual questions into structured analytic steps and highlighting semantically relevant chart areas. Leveraging large language and vision-language models, ViStruct identifies chart components, maps subtasks to spatial regions, and presents visual attention cues to externalize expert-like reasoning flows. While not designed for direct novice instruction, ViStruct provides a replicable model of expert interpretation that can inform the development of future visual literacy tools. We evaluate the system on 45 tasks across 12 chart types and validate its outputs with trained visualization users, confirming its ability to produce interpretable and expert-aligned reasoning sequences.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 4 of its 34 references that are in the map. First posted on arXiv 26 Jun 2025.

Builds on

4 of 34 references.

References · 4

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2024Do Vision-Language Models Really Understand Visual Language?cited by 32
  3. 2024Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustnesscited by 17
  4. 2024RelationVLM: Making Large Vision-Language Models Understand Visual Relationscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ChartProbe: A Diagnostic Study on Visual Reasoning through Perception, Grounding, and Simple Reasoning
  2. 2025Probing the Visualization Literacy of Vision Language Models: the Good, the Bad, and the Ugly
  3. 2025VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
  4. 2025Do Vision-Language Models See Visualizations Like Humans? Alignment in Chart Categorization
  5. 2026VisDoT : Enhancing Visual Reasoning through Human-Like Interpretation Grounding and Decomposition of Thought
  6. 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning
  7. 2025EncQA: Benchmarking Vision-Language Models on Visual Encodings for Charts
  8. 2025See or Recall: A Sanity Check for the Role of Vision in Solving Visualization Question Answer Tasks with Multimodal LLMs