# Gallery D.C.: Auto-created GUI Component Gallery for Design Search and Knowledge Discovery

arXiv: https://arxiv.org/abs/2204.06700 · HTML: https://mlsanity.com/paper/2204.06700/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Apr 2022.

## Built on by (most cited first, 5 of 5)

- [Boosting GUI Prototyping with Diffusion Models](https://mlsanity.com/paper/2306.06233/) (2023)
- [Agent for User: Testing Multi-User Interactive Features in TikTok](https://mlsanity.com/paper/2504.15474/) (2025)
- [AI-Assisted Causal Pathway Diagram for Human-Centered Design](https://mlsanity.com/paper/2403.08111/) (2024)
- [Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approach](https://mlsanity.com/paper/2408.17404/) (2024)
- [Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing](https://mlsanity.com/paper/2506.17539/) (2025)

## Abstract (arXiv)

GUI design is an integral part of software development. The process of designing a mobile application typically starts with the ideation and inspiration search from existing designs. However, existing information-retrieval based, and database-query based methods cannot efficiently gain inspirations in three requirements: design practicality, design granularity and design knowledge discovery. In this paper we propose a web application, called tool that aims to facilitate the process of user interface design through real world GUI component search. Gallery D.C. indexes GUI component designs using reverse engineering and deep learning based computer vision techniques on millions of real world applications. To perform an advanced design search and knowledge discovery, our approach extracts information about size, color, component type, and text information to help designers explore multi-faceted design space and distill higher-order of design knowledge. Gallery D.C. is well received via an informal evaluation with 7 professional designers. Web Link: http://mui-collection.herokuapp.com/. Demo Video Link: https://youtu.be/zVmszwY5OQ.
