Bridging Natural Language and Interactive What-If Interfaces via LLM-Generated Declarative Specifications
Not on the map. Why?
Abstract (arXiv)
What-if analysis (WIA) lets users explore hypothetical scenarios by adjusting parameters, applying constraints, and scoping data through interactive interfaces. Current tools fall short: spreadsheet and BI tools require laborious setup, while LLM-generated interfaces frequently misinterpret analytical intent. It remains unclear whether an explicit intermediate representation is needed, or whether LLMs can generate WIA interfaces directly. We build a benchmark of 405 WIA questions across 11 types and 5 datasets with human-authored ground-truth intent, and find that direct one-shot generation across three LLMs fails to produce a working interface in 17-45% of cases and, when interfaces render, often misrepresents the question's objective (up to 77.5%) and constraints (up to 58.2%). We therefore present a two-stage workflow that translates NL questions into Praxa Specification Language (PSL) specifications, then compiles them into interfaces. Because errors localize to named properties, taxonomy-guided repair raises correctness from 52.42% to 80.42%, unlike errors in directly generated code.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 63 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
17 of 63 references.
References · 17
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 71
- 2024DynaVis: Dynamically Synthesized UI Widgets for Visualization Editingcited by 34
- 2019FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow Systemcited by 25
- 2024LEVA: Using Large Language Models to Enhance Visual Analyticscited by 24
- 2017Iris: A Conversational Agent for Complex Taskscited by 22
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Waycited by 19
- 2023Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorationscited by 18
- 2020InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devicescited by 12
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
- 2025Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data Annotationcited by 6
5 more
- 2021Augmenting Decision Making via Interactive What-If Analysiscited by 3
- 2022What-if Analysis for Business Professionals: Current Practices and Future Opportunitiescited by 3
- 2023HAiVA: Hybrid AI-assisted Visual Analysis Framework to Study the Effects of Cloud Properties on Climate Patternscited by 2
- 2022Cicero: A Declarative Grammar for Responsive Visualizationcited by 1
- 2025PRAXA: A Grammar for What-If Analysiscited by 1
Built on by
Not cited yet.