mlsanityData to 7 Oct 2026

GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networks

arXiv 2101.09978 ↗First posted 25 Jan 2021cs.HC cs.CV cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Graphical User Interface (GUI) is ubiquitous in almost all modern desktop software, mobile applications, and online websites. A good GUI design is crucial to the success of the software in the market, but designing a good GUI which requires much innovation and creativity is difficult even to well-trained designers. Besides, the requirement of the rapid development of GUI design also aggravates designers' working load. So, the availability of various automated generated GUIs can help enhance the design personalization and specialization as they can cater to the taste of different designers. To assist designers, we develop a model GUIGAN to automatically generate GUI designs. Different from conventional image generation models based on image pixels, our GUIGAN is to reuse GUI components collected from existing mobile app GUIs for composing a new design that is similar to natural-language generation. Our GUIGAN is based on SeqGAN by modeling the GUI component style compatibility and GUI structure. The evaluation demonstrates that our model significantly outperforms the best of the baseline methods by 30.77% in Frechet Inception distance (FID) and 12.35% in 1-Nearest Neighbor Accuracy (1-NNA). Through a pilot user study, we provide initial evidence of the usefulness of our approach for generating acceptable brand new GUI designs.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 26 of its 69 references that are in the map. First posted on arXiv 25 Jan 2021.

Builds on

26 of 69 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2016Improved Techniques for Training GANscited by 2,938
  4. 2017Improved Training of Wasserstein GANscited by 2,223
  5. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  6. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  7. 2017Wasserstein GANcited by 635
  8. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  9. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  10. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  11. 2016Revisiting Classifier Two-Sample Testscited by 258
  12. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
14 more
  1. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
  2. 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
  3. 2018An empirical study on evaluation metrics of generative adversarial networkscited by 81
  4. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
  5. 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
  6. 2020Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?cited by 29
  7. 2020Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learningcited by 25
  8. 2020Owl Eyes: Spotting UI Display Issues via Visual Understandingcited by 16
  9. 2019Controllable and Progressive Image Extrapolationcited by 13
  10. 2019StoryDroid: Automated Generation of Storyboard for Android Appscited by 8
  11. 2019Enabling Hyper-Personalisation: Automated Ad Creative Generation and Ranking for Fashion e-Commercecited by 8
  12. 2015Colors -Messengers of Concepts: Visual Design Mining for Learning Color Semanticscited by 7
  13. 2018Use of Neural Signals to Evaluate the Quality of Generative Adversarial Network Performance in Facial Image Generationcited by 7
  14. 2019Guigle: A GUI Search Engine for Android Appscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 2; 2024: 3; 2025: 2; 2026: 3.

17 papers.

Sort:

By area: