CoGen: Creation of Reusable UI Components in Figma via Textual Commands
Not on the map. Why?
Abstract (arXiv)
The evolution of User Interface design has emphasized the need for efficient, reusable, and editable components to ensure an efficient design process. This research introduces CoGen, a system that uses machine learning techniques to generate reusable UI components directly in Figma, one of the most popular UI design tools. Addressing gaps in current systems, CoGen focuses on creating atomic components such as buttons, labels, and input fields using structured JSON and natural language prompts. The project integrates Figma API data extraction, Seq2Seq models, and fine-tuned T5 transformers for component generation. The key results demonstrate the efficiency of the T5 model in prompt generation, with an accuracy of 98% and a BLEU score of 0.2668, which ensures the mapping of JSON to descriptive prompts. For JSON creation, CoGen achieves a success rate of up to 100% in generating simple JSON outputs for specified component types.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 36 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
13 of 36 references.
References · 13
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 120
- 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
- 2019Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Networkcited by 23
- 2021GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networkscited by 17
- 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
- 2023Boosting GUI Prototyping with Diffusion Modelscited by 10
- 2020Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoderscited by 8
- 2021Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Modelscited by 8
- 2023Prompt Middleware: Mapping Prompts for Large Language Models to UI Affordancescited by 7
- 2021Magic Layouts: Structural Prior for Component Detection in User Interface Designscited by 5
- 2022Understanding and Supporting the Design Systems Practicecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.