From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
Not on the map. Why?
Abstract (arXiv)
Mobile apps are essential in daily life but frequently employ deceptive patterns, such as visual emphasis or linguistic nudging, to manipulate user behavior. Existing research largely relies on manual detection, which is time-consuming and cannot keep pace with rapidly evolving apps. Although recent work has explored automated approaches, these methods are limited to intra-page patterns, depend on manual app exploration, and lack flexibility. To address these limitations, we present AppRay, a system that integrates task-oriented app exploration with automated deceptive pattern detection to reduce manual effort, expand detection coverage, and improve performance. AppRay operates in two stages. First, it combines large language model-guided task-oriented exploration with random exploration to capture diverse user interface (UI) states. Second, it detects both intra-page and inter-page deceptive patterns using a contrastive learning-based multi-label classifier augmented with a rule-based refiner for context-aware detection. We contribute two datasets, AppRay-Tainted-UIs and AppRay-Benign-UIs, comprising 2,185 deceptive pattern instances, including 149 intra-page cases, spanning 16 types across 876 deceptive and 871 benign UIs, while preserving UI relationships. Experimental results show that AppRay achieves macro/micro averaged precision of 0.92/0.85, recall of 0.86/0.88, and F1 scores of 0.89/0.85, yielding 27.14% to 1200% improvements over prior methods and enabling effective detection of previously unexplored deceptive patterns.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 77 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
25 of 77 references.
References · 25
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
- 2023Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automationcited by 58
- 2023Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware Decisionscited by 41
- 2020Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?cited by 29
- 2020Dark Patterns after the GDPR: Scraping Consent Pop-ups and Demonstrating their Influencecited by 27
- 2020Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learningcited by 25
- 2020Owl Eyes: Spotting UI Display Issues via Visual Understandingcited by 16
- 2024GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and Learningcited by 14
13 more
- 2023AidUI: Toward Automated Recognition of Dark Patterns in User Interfacescited by 9
- 2023Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applicationscited by 9
- 2021I am Definitely Manipulated, Even When I am Aware of it. It s Ridiculous! -- Dark Patterns from the End-User Perspectivecited by 8
- 2020Dark Patterns and the Legal Requirements of Consent Banners: An Interaction Criticism Perspectivecited by 6
- 2020MadDroid: Characterising and Detecting Devious Ad Content for Android Appscited by 5
- 2022The Distressing Ads That Persist: Uncovering The Harms of Targeted Weight-Loss Ads Among Users with Histories of Disordered Eatingcited by 5
- 2021I Want My App That Way: Reclaiming Sovereignty Over Personal Devicescited by 4
- 2023Automated and Context-Aware Repair of Color-Related Accessibility Issues for Android Appscited by 3
- 2022GreaseVision: Rewriting the Rules of the Interfacecited by 2
- 2023Linguistic Dead-Ends and Alphabet Soup: Finding Dark Patterns in Japanese Appscited by 2
- 2023Getting Trapped in Amazon's "Iliad Flow": A Foundation for the Temporal Analysis of Dark Patternscited by 2
- 2017What Aspects of Mobile Ads Do Users Care About? An Empirical Study of Mobile In-app Ad Reviewscited by 1
- 2020Do Users Care about Ad's Performance Costs? Exploring the Effects of the Performance Costs of In-App Ads on User Experiencecited by 1
Built on by
Not cited yet.