# Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketching

arXiv: https://arxiv.org/abs/2501.18588 · HTML: https://mlsanity.com/paper/2501.18588/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 70 references that are in the map.
- First posted on arXiv 30 Jan 2025.

## Builds on (most cited first, 22 of 22)

- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks](https://mlsanity.com/paper/2005.11401/) (2020)
- [BERTScore: Evaluating Text Generation with BERT](https://mlsanity.com/paper/1904.09675/) (2019)
- [InstructPix2Pix: Learning to Follow Image Editing Instructions](https://mlsanity.com/paper/2211.09800/) (2022)
- [Palette: Image-to-Image Diffusion Models](https://mlsanity.com/paper/2111.05826/) (2021)
- [Holistically-Nested Edge Detection](https://mlsanity.com/paper/1504.06375/) (2015)
- [U2-Net: Going Deeper with Nested U-Structure for Salient Object Detection](https://mlsanity.com/paper/2005.09007/) (2020)
- [Homogenization Effects of Large Language Models on Human Creative Ideation](https://mlsanity.com/paper/2402.01536/) (2024)
- [Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models](https://mlsanity.com/paper/2304.09337/) (2023)
- [The Effects of Generative AI on Design Fixation and Divergent Thinking](https://mlsanity.com/paper/2403.11164/) (2024)
- [A Prompt Log Analysis of Text-to-Image Generation Systems](https://mlsanity.com/paper/2303.04587/) (2023)
- [The Prompt Artists](https://mlsanity.com/paper/2303.12253/) (2023)
- [Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systems](https://mlsanity.com/paper/2305.07465/) (2023)
- [Generative Disco: Text-to-Video Generation for Music Visualization](https://mlsanity.com/paper/2304.08551/) (2023)
- [Data-Driven Design-by-Analogy: State of the Art and Future Directions](https://mlsanity.com/paper/2106.01592/) (2021)
- [Text-to-Image Generation for Abstract Concepts](https://mlsanity.com/paper/2309.14623/) (2023)
- [Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models](https://mlsanity.com/paper/2310.08574/) (2023)
- [Block and Detail: Scaffolding Sketch-to-Image Generation](https://mlsanity.com/paper/2402.18116/) (2024)
- [Prompt Optimizer of Text-to-Image Diffusion Models for Abstract Concept Understanding](https://mlsanity.com/paper/2404.11589/) (2024)
- [dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketching](https://mlsanity.com/paper/2104.12297/) (2021)
- [C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model](https://mlsanity.com/paper/2401.12586/) (2024)
- [BioSpark: An End-to-End Generative System for Biological-Analogical Inspirations and Ideation](https://mlsanity.com/paper/2312.11388/) (2023)

## Built on by (most cited first, 13 of 13)

- [Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshop](https://mlsanity.com/paper/2508.21036/) (2025)
- [DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design](https://mlsanity.com/paper/2502.09867/) (2025)
- [GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design](https://mlsanity.com/paper/2508.15227/) (2025)
- [SYNTHIA: Novel Concept Design with Affordance Composition](https://mlsanity.com/paper/2502.17793/) (2025)
- [StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagation](https://mlsanity.com/paper/2508.03182/) (2025)
- [Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Models](https://mlsanity.com/paper/2512.18388/) (2025)
- [DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignment](https://mlsanity.com/paper/2511.15331/) (2025)
- [AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration](https://mlsanity.com/paper/2511.17906/) (2025)
- [Beyond Input-Output: Rethinking Creativity through Design-by-Analogy in Human-AI Collaboration](https://mlsanity.com/paper/2602.09423/) (2026)
- [When Drawing Is Not Enough: Exploring Spontaneous Speech with Sketch for Intent Alignment in Multimodal LLMs](https://mlsanity.com/paper/2604.11964/) (2026)
- [Design Generative AI for Practitioners: Exploring Interaction Approaches Aligned with Creative Practice](https://mlsanity.com/paper/2603.03074/) (2026)
- [Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AI](https://mlsanity.com/paper/2606.09848/) (2026)
- [InstanceControl: Controllable Complex Image Generation without Instance Labeling](https://mlsanity.com/paper/2606.31924/) (2026)

## Abstract (arXiv)

With recent advancements in the capabilities of Text-to-Image (T2I) AI models, product designers have begun experimenting with them in their work. However, T2I models struggle to interpret abstract language and the current user experience of T2I tools can induce design fixation rather than a more iterative, exploratory process. To address these challenges, we developed Inkspire, a sketch-driven tool that supports designers in prototyping product design concepts with analogical inspirations and a complete sketch-to-design-to-sketch feedback loop. To inform the design of Inkspire, we conducted an exchange session with designers and distilled design goals for improving T2I interactions. In a within-subjects study comparing Inkspire to ControlNet, we found that Inkspire supported designers with more inspiration and exploration of design ideas, and improved aspects of the co-creative process by allowing designers to effectively grasp the current state of the AI to guide it towards novel design intentions.
