mlsanityData to 14 Oct 2026

ChatImage: Navigating Long-Form LLM Answers through Interactive Images

arXiv 2607.05290 ↗First posted 6 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) can produce detailed answers to complex queries, but these answers are typically presented as dense linear text, which makes fine-grained inspection, navigation, and return visits difficult. We present ChatImage, a system that converts long-form LLM answers into interactive visual images. Given a textual answer, ChatImage first normalizes its content into structured visual modules, plans a visual layout, and renders a coherent image. It then applies a second grounding pass to the rendered image with vision grounding models such as LocateAnything and MiMo-Vision, with optional SAM-style mask refinement, to identify the visible regions that should support interaction. From these grounded regions, ChatImage overlays transparent clickable hotspots on the image. Each hotspot opens a detail panel and a region-scoped follow-up thread, allowing the user to inspect and query a specific part of the answer without re-reading the full response. Instead of treating planned coordinates as the final interaction geometry, ChatImage uses them as priors and grounds the interaction targets after rendering, which improves consistency between visual content and clickable regions. We release a reference implementation and introduce a 30-question benchmark covering infographic, map, and scene-based answer formats. Evaluation with configured external models reports interaction-loop completion, a strict visual-alignment gate, and a SAM-based mask-completeness diagnostic.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 83 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

9 of 83 references.

References · 9

  1. 2019Explainable AI for Trees: From Local Explanations to Global Understandingcited by 65
  2. 2022Leakage and the Reproducibility Crisis in ML-based Sciencecited by 65
  3. 2018Kymatio: Scattering Transforms in Pythoncited by 58
  4. 2013Deep Scattering Spectrumcited by 52
  5. 2017Cross-validation failure: small sample sizes lead to large error barscited by 43
  6. 2023Graph Neural Network-based EEG Classification: A Surveycited by 21
  7. 2016An unexpected unity among methods for interpreting model predictionscited by 17
  8. 2021Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Modelscited by 13
  9. 2019Classification of EEG-Based Brain Connectivity Networks in Schizophrenia Using a Multi-Domain Connectome Convolutional Neural Networkcited by 11

Built on by

Not cited yet.