mlsanityData to 7 Oct 2026

Reimagining Application User Interface (UI) Design using Deep Learning Methods: Challenges and Opportunities

arXiv 2303.13055 ↗First posted 23 Mar 2023cs.HC cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a review of the recent work in deep learning methods for user interface design. The survey encompasses well known deep learning techniques (deep neural networks, convolutional neural networks, recurrent neural networks, autoencoders, and generative adversarial networks) and datasets widely used to design user interface applications. We highlight important problems and emerging research frontiers in this field. We believe that the use of deep learning for user interface design automation tasks could be one of the high potential fields for the advancement of the software development industry.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 123 references that are in the map. First posted on arXiv 23 Mar 2023.

Builds on

26 of 123 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Going Deeper with Convolutionscited by 4,231
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2016An overview of gradient descent optimization algorithmscited by 1,021
  5. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 415
  6. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
  7. 2018Activation Functions: Comparison of trends in Practice and Research for Deep Learningcited by 130
  8. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
  9. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  10. 2019Convolutional Character Networkscited by 61
  11. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
  12. 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
14 more
  1. 2018Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typologycited by 35
  2. 2020Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?cited by 29
  3. 2017Learning Visual Importance for Graphic Designs and Data Visualizationscited by 22
  4. 2021Wireframe-Based UI Design Search Through Image Autoencodercited by 17
  5. 2020GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted Feedbackcited by 11
  6. 2019Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applicationscited by 7
  7. 2019Serif or Sans: Visual Font Analytics on Book Covers and Online Advertisementscited by 7
  8. 2014Autofolding for Source Code Summarizationcited by 6
  9. 2017Convolutional Neural Networks for Font Classificationcited by 6
  10. 2018Detecting and Summarizing GUI Changes in Evolving Mobile Appscited by 4
  11. 2018Do we agree on user interface aesthetics of Android apps?cited by 3
  12. 2019Targeted Example Generation for Compilation Errorscited by 3
  13. 2017Mining Behavioral Patterns from Millions of Android Userscited by 2
  14. 2019Learning to Infer User Interface Attributes from Imagescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.