ClearFairy: Capturing Creative Workflows through Decision Structuring, In-Situ Questioning, and Rationale Inference
Not on the map. Why?
Abstract (arXiv)
Capturing professionals' decision-making in creative workflows (e.g., UI/UX) is essential for reflection, collaboration, and knowledge sharing, yet existing methods often leave rationales incomplete and implicit decisions hidden. To address this, we present the CLEAR approach, which structures reasoning into cognitive decision steps-linked units of actions, artifacts, and explanations making decisions traceable with generative AI. Building on CLEAR, we introduce ClearFairy, a think-aloud AI assistant for UI design that detects weak explanations, asks lightweight clarifying questions, and infers missing rationales. In a study with twelve professionals, 85% of ClearFairy's inferred rationales were accepted (as-is or with revisions). Notably, the system increased "strong explanations"-rationales providing sufficient causal reasoning-from 14% to 83% without adding cognitive demand. Furthermore, exploratory applications demonstrate that captured steps can enhance generative AI agents in Figma, yielding predictions better aligned with professionals and producing coherent outcomes. We release a dataset of 417 decision steps to support future research.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 198 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
28 of 198 references.
References · 28
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 139
- 2024Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agentscited by 50
- 2023Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Datacited by 48
- 2025Creating General User Models from Computer Usecited by 44
- 2024Need Help? Designing Proactive AI Assistants for Programmingcited by 43
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
- 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 39
- 2024The Effects of Generative AI on Design Fixation and Divergent Thinkingcited by 37
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
16 more
- 2025Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Supportcited by 34
- 2024Generating Automatic Feedback on UI Mockups with Large Language Modelscited by 23
- 2024Enhancing Critical Thinking in Education by means of a Socratic Chatbotcited by 21
- 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20
- 2025Digi-Q: Learning Q-Value Functions for Training Device-Control Agentscited by 20
- 2024One vs. Many: Comprehending Accurate Information from Multiple Erroneous and Inconsistent AI Generationscited by 13
- 2024Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web Agentscited by 13
- 2024Demystifying Tacit Knowledge in Graphic Design: Characteristics, Instances, Approaches, and Guidelinescited by 10
- 2025AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Toolscited by 8
- 2021Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processingcited by 6
- 2024TutoAI: A Cross-domain Framework for AI-assisted Mixed-media Tutorial Creation on Physical Taskscited by 6
- 2023DiLogics: Creating Web Automation Programs With Diverse Logicscited by 5
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
- 2023Understanding Collaborative Practices and Tools of Professional UX Practitioners in Software Organizationscited by 3
- 2024Tutorly: Turning Programming Videos Into Apprenticeship Learning Environments with LLMscited by 3
- 2025Fuzzy Linkography: Automatic Graphical Summarization of Creative Activity Tracescited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026CogInstrument: Modeling Cognitive Processes for Bidirectional Human-LLM Alignment in Planning Taskscited by 0
- 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Toolscited by 0
- 2026TailorCoPilot: Enabling Agentic Pattern Making with Version-Controlled State Trackingcited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents24 Sep 2026
- 2026TailorCoPilot: Enabling Agentic Pattern Making with Version-Controlled State Tracking26 Aug 2026
- 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Tools24 Jul 2026
- 2026CogInstrument: Modeling Cognitive Processes for Bidirectional Human-LLM Alignment in Planning Tasks12 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing
- 2026Governing Reflective Human-AI Collaboration: A Framework for Epistemic Scaffolding and Traceable Reasoning
- 2025Universe of Thoughts: Enabling Creative Reasoning with Large Language Models
- 2025ComfyUI-R1: Exploring Reasoning Models for Workflow Generation
- 2026The Reasoning-Creativity Trade-off: Toward Creativity-Driven Problem Solving
- 2026IntElicit: Eliciting and Assessing Contextualized Creativity via Dialogue Policy Optimization
- 2026Knowledge-Centric Agents for Workflow Generation in ComfyUI
- 2025FlexMind: Supporting Deeper Creative Thinking with LLMs