mlsanityData to 14 Oct 2026

VisInteract: Towards Dynamic Interactive Text-to-Visualization under Imperfect Queries

arXiv 2609.15182 ↗First posted 14 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-world visualization requests are routinely ambiguous, incomplete, or factually incorrect, yet existing Text-to-Visualization (Text-to-Vis) systems assume well-specified inputs and produce charts in a single pass. When queries are imperfect, a system must interact with the user to recover the true intent, but no benchmark or method supports this dynamic process. We introduce VisInteract, a new paradigm that reframes Text-to-Vis as interaction-driven intent recovery, and VisInteract-Bench, to our knowledge, that is the first benchmark for dynamic interactive Text-to-Vis, featuring controlled imperfection injection, a leakage-controlled User Agent for realistic multi-turn feedback, and dual-perspective (code and chart) automated evaluation. On the algorithmic side, we propose Vis-MCTS, a Monte Carlo Tree Search (MCTS) enhanced method, introducing improvements over classical MCTS, that Progressive Widening to tame the unbounded tool-argument space in tree search, cross-rollout information sharing so clarifications and critiques benefit the entire search tree, and Dimension-Aware Reward Decomposition that routes scalar user feedback along data-fidelity, visual-design, and intent-alignment dimensions to resolve credit assignment across heterogeneous actions. Extensive Experiments across two LLM backbones show that Vis-MCTS consistently outperforms all Text-to-Vis baselines, improving end-to-end task success by 13.40%--16.27% over the strongest interactive baseline and by more than 5× over non-interactive ones.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

25 of 45 references.

References · 25

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  6. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  7. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
  8. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  9. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  10. 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 446
  11. 2024Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8Bcited by 158
  12. 2024Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solverscited by 138
13 more
  1. 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
  2. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
  3. 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 73
  4. 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 59
  5. 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 45
  6. 2019Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Studycited by 40
  7. 2023Data Formulator: AI-powered Concept-driven Visualization Authoringcited by 32
  8. 2021Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizationscited by 31
  9. 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflowcited by 23
  10. 2023Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Modelscited by 20
  11. 2023Marrying Dialogue Systems with Data Visualization: Interactive Data Visualization Generation from Natural Language Conversationscited by 9
  12. 2026MultiVis-Agent: A Multi-Agent Framework with Logic Rules for Reliable and Comprehensive Cross-Modal Data Visualizationcited by 3
  13. 2024Towards Robustness of Text-to-Visualization Translation against Lexical and Phrasal Variabilitycited by 2

Built on by

Not cited yet.