mlsanityData to 14 Oct 2026

Pairwise GUI Dataset Construction Between Android Phones and Tablets

arXiv 2310.04755 ↗First posted 7 Oct 2023cs.SE cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

In the current landscape of pervasive smartphones and tablets, apps frequently exist across both platforms. Although apps share most graphic user interfaces (GUIs) and functionalities across phones and tablets, developers often rebuild from scratch for tablet versions, escalating costs and squandering existing design resources. Researchers are attempting to collect data and employ deep learning in automated GUIs development to enhance developers' productivity. There are currently several publicly accessible GUI page datasets for phones, but none for pairwise GUIs between phones and tablets. This poses a significant barrier to the employment of deep learning in automated GUI development. In this paper, we introduce the Papt dataset, a pioneering pairwise GUI dataset tailored for Android phones and tablets, encompassing 10,035 phone-tablet GUI page pairs sourced from 5,593 unique app pairs. We propose novel pairwise GUI collection approaches for constructing this dataset and delineate its advantages over currently prevailing datasets in the field. Through preliminary experiments on this dataset, we analyze the present challenges of utilizing deep learning in automated GUI development.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 7 Oct 2023.

Builds on

22 of 45 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2013Auto-Encoding Variational Bayescited by 4,053
  4. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  5. 2015A note on the evaluation of generative modelscited by 292
  6. 2018Statistical Aspects of Wasserstein Distancescited by 203
  7. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  8. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  9. 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 120
  10. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  11. 2021Variational Transformer Networks for Layout Generationcited by 88
  12. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
10 more
  1. 2021VINS: Visual Search for Mobile User Interface Designcited by 37
  2. 2022Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scalecited by 30
  3. 2020Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learningcited by 25
  4. 2021Robustness of on-device Models: Adversarial Attack to Deep Learning Models on Android Appscited by 19
  5. 2021Wireframe-Based UI Design Search Through Image Autoencodercited by 17
  6. 2020GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted Feedbackcited by 11
  7. 2020ORCSolver: An Efficient Solver for Adaptive GUI Layout with OR-Constraintscited by 6
  8. 2022ReverseORC: Reverse Engineering of Resizable User Interface Layouts with OR-Constraintscited by 6
  9. 2023A First Look at On-device Models in iOS Appscited by 3
  10. 2023Automated Mapping of Adaptive App GUIs from Phones to TVscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026OpenHarmony Bench: Evaluating LLMs and Coding Agents on OpenHarmony App Developmentcited by 0