ReFinE: Streamlining UI Mockup Iteration with Research Findings
Not on the map. Why?
Abstract (arXiv)
Although HCI research papers offer valuable design insights, designers often struggle to apply them in design workflows due to difficulties in finding relevant literature, understanding technical jargon, the lack of contextualization, and limited actionability. To address these challenges, we present ReFinE, a Figma plugin that supports real-time design iteration by surfacing contextualized insights from research papers. ReFinE identifies and synthesizes design implications from HCI literature relevant to the mockup's design context, and tailors this research evidence to a specific design mockup by providing actionable visual guidance on how to update the mockup. To assess the system's effectiveness, we conducted a technical evaluation and a user study. Results show that ReFinE effectively synthesizes and contextualizes design implications, reducing cognitive load and improving designers' ability to integrate research evidence into UI mockups. This work contributes to bridging the gap between research and design practice by presenting a tool for embedding scholarly insights into the UI design process.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
19 of 48 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2021HTLM: Hyper-Text Pre-Training and Prompting of Language Modelscited by 58
- 2021MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understandingcited by 45
- 2021VINS: Visual Search for Mobile User Interface Designcited by 37
- 2022DOM-LM: Learning Generalizable Representations for HTML Documentscited by 24
- 2022Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processingcited by 23
- 2024Generating Automatic Feedback on UI Mockups with Large Language Modelscited by 23
- 2023A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understandingcited by 18
- 2024PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Paperscited by 18
7 more
- 2025Leveraging Multimodal LLM for Inspirational User Interface Searchcited by 13
- 2024Misty: UI Prototyping Through Interactive Conceptual Blendingcited by 9
- 2023Qlarify: Recursively Expandable Abstracts for Directed Information Retrieval over Scientific Paperscited by 8
- 2017Analogy Mining for Specific Design Needscited by 6
- 2024From Paper to Card: Transforming Design Implications with Generative AIcited by 6
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Designcited by 4
- 2024DIDUP: Dynamic Iterative Development for UI Prototypingcited by 2
Built on by
Not cited yet.