DynaVis: Dynamically Synthesized UI Widgets for Visualization Editing
Not on the map. Why?
Abstract (arXiv)
Users often rely on GUIs to edit and interact with visualizations - a daunting task due to the large space of editing options. As a result, users are either overwhelmed by a complex UI or constrained by a custom UI with a tailored, fixed subset of options with limited editing flexibility. Natural Language Interfaces (NLIs) are emerging as a feasible alternative for users to specify edits. However, NLIs forgo the advantages of traditional GUI: the ability to explore and repeat edits and see instant visual feedback. We introduce DynaVis, which blends natural language and dynamically synthesized UI widgets. As the user describes an editing task in natural language, DynaVis performs the edit and synthesizes a persistent widget that the user can interact with to make further modifications. Study participants (n=24) preferred DynaVis over the NLI-only interface citing ease of further edits and editing confidence due to immediate visual feedback.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jan 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 7; 2025: 14; 2026: 13.
34 papers.
Sort:
By area:
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Executioncited by 20
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Waycited by 19
- 2024BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebookscited by 12
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivationcited by 7
- 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactionscited by 7
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelinescited by 6
- 2024Data Analysis in the Era of Generative AIcited by 6
- 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Designcited by 6
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2025Generative Interfaces for Language Modelscited by 5
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
22 more
- 2025"The Diagram is like Guardrails": Structuring GenAI-assisted Hypotheses Exploration with an Interactive Shared Representationcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfacescited by 3
- 2026AlignUI: A Method for Designing LLM-Generated UIs Aligned with User Preferencescited by 2
- 2025HiLDe: Intentional Code Generation via Human-in-the-Loop Decodingcited by 1
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writingcited by 1
- 2025Story Ribbons: Reimagining Storyline Visualizations with Large Language Modelscited by 1
- 2025A Generative AI System for Biomedical Data Discovery with Grammar-Based Visualizationscited by 1
- 2025YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discoverycited by 1
- 2026Generative Experiences for Digital Mental Health Interventions: Evidence from a Randomized Studycited by 1
- 2026PSI: Shared State as the Missing Layer for Coherent AI-Generated Instruments in Personal AI Agentscited by 1
- 2025Exploring the Innovation Opportunities for Pre-trained Modelscited by 0
- 2025The Command Line GUIde: Graphical Interfaces from Man Pages via AIcited by 0
- 2026From Static to Interactive: Authoring Interactive Visualizations via Natural Languagecited by 0
- 2026Bridging Natural Language and Interactive What-If Interfaces via LLM-Generated Declarative Specificationscited by 0
- 2026Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformationcited by 0
- 2026MAIC-UI: Making Interactive Courseware with Generative UIcited by 0
- 2026Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Controlcited by 0
- 2026REChart: Reasoning-Efficient Chart Editing with Large Reasoning Modelscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026AI Soccer Analyst: Stage-Aware and Verifiable Human-AI Collaboration for Soccer Data Analysiscited by 0
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?cited by 0
- 2026AI Soccer Analyst: Stage-Aware and Verifiable Human-AI Collaboration for Soccer Data Analysis10 Sep 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026REChart: Reasoning-Efficient Chart Editing with Large Reasoning Models18 Aug 2026
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?11 Aug 2026
- 2026Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control11 Jul 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026MAIC-UI: Making Interactive Courseware with Generative UI28 Apr 2026
- 2026Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformation16 Apr 2026
- 2026PSI: Shared State as the Missing Layer for Coherent AI-Generated Instruments in Personal AI Agents9 Apr 2026
- 2026Bridging Natural Language and Interactive What-If Interfaces via LLM-Generated Declarative Specifications8 Apr 2026
- 2026Generative Experiences for Digital Mental Health Interventions: Evidence from a Randomized Study8 Apr 2026
- 2026From Static to Interactive: Authoring Interactive Visualizations via Natural Language25 Jan 2026
22 more
- 2026AlignUI: A Method for Designing LLM-Generated UIs Aligned with User Preferences24 Jan 2026
- 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactions16 Oct 2025
- 2025The Command Line GUIde: Graphical Interfaces from Man Pages via AI1 Oct 2025
- 2025YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discovery23 Sep 2025
- 2025A Generative AI System for Biomedical Data Discovery with Grammar-Based Visualizations19 Sep 2025
- 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces16 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
- 2025Generative Interfaces for Language Models26 Aug 2025
- 2025Story Ribbons: Reimagining Storyline Visualizations with Large Language Models9 Aug 2025
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writing4 Jun 2025
- 2025HiLDe: Intentional Code Generation via Human-in-the-Loop Decoding28 May 2025
- 2025Exploring the Innovation Opportunities for Pre-trained Models21 May 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
- 2025"The Diagram is like Guardrails": Structuring GenAI-assisted Hypotheses Exploration with an Interactive Shared Representation21 Mar 2025
- 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design14 Feb 2025
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Execution8 Nov 2024
- 2024Data Analysis in the Era of Generative AI27 Sep 2024
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelines20 Sep 2024
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way28 Aug 2024
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2024BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks10 Apr 2024
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation12 Feb 2024
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Executioncited by 20
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelinescited by 6
- 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfacescited by 3
- 2026Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformationcited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformation16 Apr 2026
- 2025DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces16 Sep 2025
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Execution8 Nov 2024
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelines20 Sep 2024
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Waycited by 19
- 2024BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebookscited by 12
- 2024Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivationcited by 7
- 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactionscited by 7
- 2024Data Analysis in the Era of Generative AIcited by 6
- 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Designcited by 6
- 2025Generative Interfaces for Language Modelscited by 5
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
- 2025"The Diagram is like Guardrails": Structuring GenAI-assisted Hypotheses Exploration with an Interactive Shared Representationcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025HiLDe: Intentional Code Generation via Human-in-the-Loop Decodingcited by 1
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writingcited by 1
12 most cited of 24 All 24 (JSON)
- 2026AI Soccer Analyst: Stage-Aware and Verifiable Human-AI Collaboration for Soccer Data Analysis10 Sep 2026
- 2026Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control11 Jul 2026
- 2026MAIC-UI: Making Interactive Courseware with Generative UI28 Apr 2026
- 2026PSI: Shared State as the Missing Layer for Coherent AI-Generated Instruments in Personal AI Agents9 Apr 2026
- 2026Bridging Natural Language and Interactive What-If Interfaces via LLM-Generated Declarative Specifications8 Apr 2026
- 2026Generative Experiences for Digital Mental Health Interventions: Evidence from a Randomized Study8 Apr 2026
- 2026From Static to Interactive: Authoring Interactive Visualizations via Natural Language25 Jan 2026
- 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactions16 Oct 2025
- 2025The Command Line GUIde: Graphical Interfaces from Man Pages via AI1 Oct 2025
- 2025YAC: Bridging Natural Language and Interactive Visual Exploration with Generative AI for Biomedical Data Discovery23 Sep 2025
- 2025A Generative AI System for Biomedical Data Discovery with Grammar-Based Visualizations19 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
12 newest of 24 All 24 (JSON)