GUI Test Migration via Abstraction and Concretization
Not on the map. Why?
Abstract (arXiv)
GUI test migration aims to produce test cases with events and assertions to test specific functionalities of a target app. Existing migration approaches typically focus on the widget-mapping paradigm that maps widgets from source apps to target apps. However, since different apps may implement the same functionality in different ways, direct mapping may result in incomplete or buggy test cases, thus significantly impacting the effectiveness of testing target functionality and the practical applicability of migration approaches. In this paper, we propose a new migration paradigm (i.e., the abstraction-concretization paradigm) that first abstracts the test logic for the target functionality and then utilizes this logic to generate the concrete GUI test case. Furthermore, we introduce MACdroid, the first approach that migrates GUI test cases based on this paradigm. Specifically, we propose an abstraction technique that utilizes source test cases from source apps targeting the same functionality to extract a general test logic for that functionality. Then, we propose a concretization technique that utilizes the general test logic to guide an LLM in generating the corresponding GUI test case (including events and assertions) for the target app. We evaluate MACdroid on two widely-used datasets (including 31 apps, 34 functionalities, and 123 test cases). On the FrUITeR dataset, the test cases generated by MACdroid successfully test 64% of the target functionalities, improving the baselines by 191%. On the Lin dataset, MACdroid successfully tests 75% of the target functionalities, outperforming the baselines by 42%. These results underscore the effectiveness of MACdroid in GUI test migration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 79 references that are in the map. First posted on arXiv 8 Sep 2024.
Builds on
26 of 79 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 314
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
- 2020Mapping Natural Language Instructions to Mobile UI Action Sequencescited by 180
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 178
- 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
- 2023DroidBot-GPT: GPT-powered UI Automation for Androidcited by 47
- 2023ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automationcited by 45
- 2023ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifierscited by 41
- 2023Prompting Is All You Need: Automated Android Bug Replay with Large Language Modelscited by 40
- 2023AXNav: Replaying Accessibility Tests from Natural Languagecited by 31
14 more
- 2023CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Modelscited by 28
- 2018Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integrationcited by 17
- 2023ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversationscited by 17
- 2020Translating Video Recordings of Mobile App Usages into Replayable Scenarioscited by 9
- 2022Nighthawk: Fully Automated Localizing UI Display Issues via Visual Understandingcited by 6
- 2018How do Developers Test Android Applications?cited by 5
- 2020FrUITeR: A Framework for Evaluating UI Test Reusecited by 3
- 2023Practical Non-Intrusive GUI Exploration Testing with Visual-based Robotic Armscited by 3
- 2020Fully Automated Functional Fuzzing of Android Apps for Detecting Non-crashing Logic Bugscited by 2
- 2022Guided Bug Crush: Assist Manual GUI Testing of Android Apps via Hint Movescited by 2
- 2023Test Reuse Based on Adaptive Semantic Matching across Android Mobile Applicationscited by 2
- 2024Practical, Automated Scenario-based Mobile App Testingcited by 2
- 2019Estimating Return on Investment for GUI Test Automation Toolscited by 1
- 2021An Evolutionary Approach to Adapt Tests Across Mobile Appscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.