# Sketch-n-Sketch: Output-Directed Programming for SVG

arXiv: https://arxiv.org/abs/1907.10699 · HTML: https://mlsanity.com/paper/1907.10699/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Jul 2019.

## Built on by (most cited first, 5 of 5)

- [FaccAID: A Transformer Model for Neuro-Symbolic Facade Reconstruction](https://mlsanity.com/paper/2406.01829/) (2024)
- [Benchmarking LLM Code Generation for Audio Programming with Visual Dataflow Languages](https://mlsanity.com/paper/2409.00856/) (2024)
- [The Command Line GUIde: Graphical Interfaces from Man Pages via AI](https://mlsanity.com/paper/2510.01453/) (2025)
- [MindTrellis: Co-Creating Knowledge Structures with AI through Interactive Visual Exploration](https://mlsanity.com/paper/2604.23129/) (2026)
- [Co-DSL: Human-LLM Co-design of Reusable Spatial Concepts for Layout Generation](https://mlsanity.com/paper/2610.15290/) (2026)

## Abstract (arXiv)

For creative tasks, programmers face a choice: Use a GUI and sacrifice flexibility, or write code and sacrifice ergonomics? To obtain both flexibility and ease of use, a number of systems have explored a workflow that we call output-directed programming. In this paradigm, direct manipulation of the program's graphical output corresponds to writing code in a general-purpose programming language, and edits not possible with the mouse can still be enacted through ordinary text edits to the program. Such capabilities provide hope for integrating graphical user interfaces into what are currently text-centric programming environments. To further advance this vision, we present a variety of new output-directed techniques that extend the expressive power of Sketch-n-Sketch, an output-directed programming system for creating programs that generate vector graphics. To enable output-directed interaction at more stages of program construction, we expose intermediate execution products for manipulation and we present a mechanism for contextual drawing. Looking forward to output-directed programming beyond vector graphics, we also offer generic refactorings through the GUI, and our techniques employ a domain-agnostic provenance tracing scheme. To demonstrate the improved expressiveness, we implement a dozen new parametric designs in Sketch-n-Sketch without text-based edits. Among these is the first demonstration of building a recursive function in an output-directed programming setting.