Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Prompts
Not on the map. Why?
Abstract (arXiv)
Creative coding tasks are often exploratory in nature. When producing digital artwork, artists usually begin with a high-level semantic construct such as a "stained glass filter" and programmatically implement it by varying code parameters such as shape, color, lines, and opacity to produce visually appealing results. Based on interviews with artists, it can be effortful to translate semantic constructs to program syntax, and current programming tools don't lend well to rapid creative exploration. To address these challenges, we introduce Spellburst, a large language model (LLM) powered creative-coding environment. Spellburst provides (1) a node-based interface that allows artists to create generative art and explore variations through branching and merging operations, (2) expressive prompt-based interactions to engage in semantic programming, and (3) dynamic prompt-driven interfaces and direct code editing to seamlessly switch between semantic and syntactic exploration. Our evaluation with artists demonstrates Spellburst's potential to enhance creative coding practices and inform the design of computational creativity tools that bridge semantic and syntactic spaces.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 14 of its 81 references that are in the map. First posted on arXiv 7 Aug 2023.
Builds on
14 of 81 references.
References · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
- 2023Foundation Models and Fair Usecited by 112
- 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
- 2019Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Networkcited by 21
- 2023The Prompt Artistscited by 21
2 more
Built on by
Citing papers per year: 2023: 2; 2024: 11; 2025: 12; 2026: 5.
30 papers.
Sort:
By area:
- 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2024Natural Language Outlines for Code: Literate Programming in the LLM Eracited by 9
- 2024JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Modelscited by 7
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Reviewcited by 5
- 2025LLM Code Customization with Visual Results: A Benchmark on TikZcited by 5
- 2026COMFYCLAW: Self-Evolving Skill Harnesses for Image Generation Workflowscited by 5
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Designcited by 4
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
- 2025A Systematic Review of Human-AI Co-Creativitycited by 4
18 more
- 2024Pinning "Reflection" on the Agenda: Investigating Reflection in Human-LLM Co-Creation for Creative Codingcited by 3
- 2024Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programmingcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025MapStory: Prototyping Editable Map Animations with LLM Agentscited by 3
- 2025FeedQUAC: Quick Unobtrusive AI-Generated Commentarycited by 2
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrationscited by 2
- 2023PortfolioMentor: Multimodal Generative AI Companion for Learning and Crafting Interactive Digital Art Portfolioscited by 1
- 2024Large Language Models as Partners in Student Essay Evaluationcited by 1
- 2024SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMscited by 1
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulationscited by 1
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writingcited by 1
- 2025Orchid: Orchestrating Context Across Creative Workflows with Generative AIcited by 1
- 2026From State Changes to Creative Decisions: Documenting and Interpreting Traces Across Creative Domainscited by 1
- 2025GenFlow: Interactive Modular System for Image Generationcited by 0
- 2025ChatGraPhT: A Visual Conversation Interface for Multi-Path Reflection with Agentic LLM Supportcited by 0
- 2026Compos3D: Interactive Part-Based Composition for Creative Control in Generative 3D Modelscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026Method, Mind, and Morality: How People Make Sense of Artificial Intelligencecited by 0
- 2026Method, Mind, and Morality: How People Make Sense of Artificial Intelligence25 Aug 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026Compos3D: Interactive Part-Based Composition for Creative Control in Generative 3D Models13 Jul 2026
- 2026COMFYCLAW: Self-Evolving Skill Harnesses for Image Generation Workflows2 Jul 2026
- 2026From State Changes to Creative Decisions: Documenting and Interpreting Traces Across Creative Domains7 Mar 2026
- 2025ChatGraPhT: A Visual Conversation Interface for Multi-Path Reflection with Agentic LLM Support28 Dec 2025
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrations29 Sep 2025
- 2025Orchid: Orchestrating Context Across Creative Workflows with Generative AI27 Aug 2025
- 2025GenFlow: Interactive Modular System for Image Generation26 Jun 2025
- 2025A Systematic Review of Human-AI Co-Creativity26 Jun 2025
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writing4 Jun 2025
- 2025MapStory: Prototyping Editable Map Animations with LLM Agents28 May 2025
18 more
- 2025LLM Code Customization with Visual Results: A Benchmark on TikZ7 May 2025
- 2025FeedQUAC: Quick Unobtrusive AI-Generated Commentary23 Apr 2025
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulations13 Apr 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Review8 Mar 2025
- 2024Cocoa: Co-Planning and Co-Execution with AI Agents14 Dec 2024
- 2024SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMs10 Sep 2024
- 2024Natural Language Outlines for Code: Literate Programming in the LLM Era9 Aug 2024
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization7 Aug 2024
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2024Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming14 Jun 2024
- 2024Large Language Models as Partners in Student Essay Evaluation28 May 2024
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedback17 Apr 2024
- 2024JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models12 Apr 2024
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Design12 Mar 2024
- 2024Pinning "Reflection" on the Agenda: Investigating Reflection in Human-LLM Co-Creation for Creative Coding15 Feb 2024
- 2023PortfolioMentor: Multimodal Generative AI Companion for Learning and Crafting Interactive Digital Art Portfolios23 Nov 2023
- 2023OpenAgents: An Open Platform for Language Agents in the Wild16 Oct 2023
- 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2025MapStory: Prototyping Editable Map Animations with LLM Agentscited by 3
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulationscited by 1
- 2025ChatGraPhT: A Visual Conversation Interface for Multi-Path Reflection with Agentic LLM Supportcited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2025ChatGraPhT: A Visual Conversation Interface for Multi-Path Reflection with Agentic LLM Support28 Dec 2025
- 2025MapStory: Prototyping Editable Map Animations with LLM Agents28 May 2025
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulations13 Apr 2025
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2023OpenAgents: An Open Platform for Language Agents in the Wild16 Oct 2023
- 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 38
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2024Natural Language Outlines for Code: Literate Programming in the LLM Eracited by 9
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Reviewcited by 5
- 2025LLM Code Customization with Visual Results: A Benchmark on TikZcited by 5
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Designcited by 4
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
- 2025A Systematic Review of Human-AI Co-Creativitycited by 4
- 2024Pinning "Reflection" on the Agenda: Investigating Reflection in Human-LLM Co-Creation for Creative Codingcited by 3
- 2024Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programmingcited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025FeedQUAC: Quick Unobtrusive AI-Generated Commentarycited by 2
12 most cited of 22 All 22 (JSON)
- 2026Method, Mind, and Morality: How People Make Sense of Artificial Intelligence25 Aug 2026
- 2026Compos3D: Interactive Part-Based Composition for Creative Control in Generative 3D Models13 Jul 2026
- 2026From State Changes to Creative Decisions: Documenting and Interpreting Traces Across Creative Domains7 Mar 2026
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrations29 Sep 2025
- 2025Orchid: Orchestrating Context Across Creative Workflows with Generative AI27 Aug 2025
- 2025GenFlow: Interactive Modular System for Image Generation26 Jun 2025
- 2025A Systematic Review of Human-AI Co-Creativity26 Jun 2025
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writing4 Jun 2025
- 2025LLM Code Customization with Visual Results: A Benchmark on TikZ7 May 2025
- 2025FeedQUAC: Quick Unobtrusive AI-Generated Commentary23 Apr 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Review8 Mar 2025
12 newest of 22 All 22 (JSON)