Sketch-n-Sketch: Output-Directed Programming for SVG
Not on the map. Why?
Abstract (arXiv)
For creative tasks, programmers face a choice: Use a GUI and sacrifice flexibility, or write code and sacrifice ergonomics? To obtain both flexibility and ease of use, a number of systems have explored a workflow that we call output-directed programming. In this paradigm, direct manipulation of the program's graphical output corresponds to writing code in a general-purpose programming language, and edits not possible with the mouse can still be enacted through ordinary text edits to the program. Such capabilities provide hope for integrating graphical user interfaces into what are currently text-centric programming environments. To further advance this vision, we present a variety of new output-directed techniques that extend the expressive power of Sketch-n-Sketch, an output-directed programming system for creating programs that generate vector graphics. To enable output-directed interaction at more stages of program construction, we expose intermediate execution products for manipulation and we present a mechanism for contextual drawing. Looking forward to output-directed programming beyond vector graphics, we also offer generic refactorings through the GUI, and our techniques employ a domain-agnostic provenance tracing scheme. To demonstrate the improved expressiveness, we implement a dozen new parametric designs in Sketch-n-Sketch without text-based edits. Among these is the first demonstration of building a recursive function in an output-directed programming setting.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2024FaccAID: A Transformer Model for Neuro-Symbolic Facade Reconstructioncited by 5
- 2024Benchmarking LLM Code Generation for Audio Programming with Visual Dataflow Languagescited by 1
- 2025The Command Line GUIde: Graphical Interfaces from Man Pages via AIcited by 0
- 2026MindTrellis: Co-Creating Knowledge Structures with AI through Interactive Visual Explorationcited by 0
- 2026Co-DSL: Human-LLM Co-design of Reusable Spatial Concepts for Layout Generationcited by 0
- 2026Co-DSL: Human-LLM Co-design of Reusable Spatial Concepts for Layout Generation11 Oct 2026
- 2026MindTrellis: Co-Creating Knowledge Structures with AI through Interactive Visual Exploration25 Apr 2026
- 2025The Command Line GUIde: Graphical Interfaces from Man Pages via AI1 Oct 2025
- 2024Benchmarking LLM Code Generation for Audio Programming with Visual Dataflow Languages1 Sep 2024
- 2024FaccAID: A Transformer Model for Neuro-Symbolic Facade Reconstruction3 Jun 2024