mlsanityData to 14 Oct 2026

Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight

arXiv 2509.10723 ↗First posted 12 Sep 2025cs.HC cs.AIcited by 16

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is increasingly important. We present a two-phase empirical study examining how agents, human participants, and human-AI teams respond to 16 types of dark patterns across diverse scenarios. Phase 1 highlights that agents often fail to recognize dark patterns, and even when aware, prioritize task completion over protective action. Phase 2 revealed divergent failure modes: humans succumb due to cognitive shortcuts and habitual compliance, while agents falter from procedural blind spots. Human oversight improved avoidance but introduced costs such as attentional tunneling and cognitive load. Our findings show neither humans nor agents are uniformly resilient, and collaboration introduces new vulnerabilities, suggesting design needs for transparency, adjustable autonomy, and oversight.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 51 of its 94 references that are in the map. First posted on arXiv 12 Sep 2025.

Builds on

51 of 94 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks20 May
  2. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  3. 2025The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injections15 Apr
  4. 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
  5. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep

Other references · 46

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  4. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  5. 2023Language Models can Solve Computer Taskscited by 372
  6. 2022Defining and Characterizing Reward Hackingcited by 203
  7. 2024OmniParser for Pure Vision Based GUI Agentcited by 198
  8. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  9. 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 171
  10. 2024GUI Agents: A Surveycited by 103
  11. 2022Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderationcited by 67
  12. 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaborationcited by 65
34 more
  1. 2024The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Usecited by 63
  2. 2022Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning taskscited by 56
  3. 2025MobileGUI-RL: Advancing Mobile GUI Agent through Reinforcement Learning in Online Environmentcited by 52
  4. 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 49
  5. 2025Levels of Autonomy for AI Agentscited by 48
  6. 2025Creating General User Models from Computer Usecited by 44
  7. 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 43
  8. 2024Cocoa: Co-Planning and Co-Execution with AI Agentscited by 39
  9. 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
  10. 2025Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Supportcited by 34
  11. 2025Detection and Mitigation of Hallucination in Large Reasoning Models: A Mechanistic Perspectivecited by 34
  12. 2024CLEAR: Towards Contextual LLM-Empowered Privacy Policy Analysis and Risk Generation for Large Language Model Applicationscited by 33
  13. 2025OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agentscited by 25
  14. 2019(Un)informed Consent: Studying GDPR Consent Notices in the Fieldcited by 23
  15. 2019Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websitescited by 19
  16. 2025Morae: Proactively Pausing UI Agents for User Choicescited by 19
  17. 2021What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methodscited by 15
  18. 2025Uncertainty-Aware GUI Agent: Adaptive Perception through Component Recommendation and Human-in-the-Loop Refinementcited by 15
  19. 2023Conceptual structure coheres in human cognition but not in large language modelscited by 14
  20. 2023An Ontology of Dark Patterns Knowledge: Foundations, Definitions, and a Pathway for Shared Knowledge-Buildingcited by 14
  21. 2021Understanding Visual Saliency in Mobile User Interfacescited by 13
  22. 2025Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agentscited by 11
  23. 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
  24. 2021I am Definitely Manipulated, Even When I am Aware of it. It s Ridiculous! -- Dark Patterns from the End-User Perspectivecited by 8
  25. 2024Listening to the Voices: Describing Ethical Caveats of Conversational User Interfaces According to Experts and Frequent Userscited by 8
  26. 2025Characterizing Unintended Consequences in Human-GUI Agent Collaboration for Web Browsingcited by 7
  27. 2023Defending Against the Dark Arts: Recognising Dark Patterns in Social Mediacited by 5
  28. 2023From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UXcited by 5
  29. 2018Endorsements on Social Media: An Empirical Study of Affiliate Marketing Disclosures on YouTube and Pinterestcited by 4
  30. 2021Ethical User Interfaces: Exploring the Effects of Dark Patterns on Facebookcited by 2
  31. 2024A Comprehensive Study on Dark Patternscited by 2
  32. 2025A Comparative Study of How People With and Without ADHD Recognise and Avoid Dark Patterns on Social Mediacited by 2
  33. 2023Beyond Dark Patterns: A Concept-Based Framework for Ethical Software Designcited by 1
  34. 2024Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performancecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 11.

16 papers.

Sort:

By area:

  1. 2025Position: Privacy Is Not Just Memorization!cited by 17
  2. 2025Investigating the Impact of Dark Patterns on LLM-Based Web Agentscited by 17
  3. 2025DECEPTICON: How Dark Patterns Manipulate Web Agentscited by 15
  4. 2026Comparing Human Oversight Strategies for Computer-Use Agentscited by 6
  5. 2025ALLOY: Generating Reusable Agent Workflows from User Demonstrationcited by 3
  6. 2026Plover: Steering GUI Agents through Plan-Centric Interactioncited by 3
  7. 2026From Human-Human Collaboration to Human-Agent Collaboration: A Vision, Design Philosophy, and an Empirical Framework for Achieving Successful Partnerships Between Humans and LLM Agentscited by 2
  8. 2025Black Box Absorption: LLMs Undermining Innovative Ideascited by 1
  9. 2026WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Taskscited by 1
  10. 2026IntentWeave: A Progressive Entry Ladder for Multi-Surface Browser Agents in Cloud Portalscited by 0
  11. 2026REDDIT: Forgetting-Resistant Correction of Timestamp Drift in ASR via Replay-Based Distribution Editingcited by 0
  12. 2026"Allow" to Achieve, Over-Privileged Inadvertently: The Unintended Cost of Task-Completion-Driven Pop-up Decisions in Mobile GUI Agentscited by 0
4 more
  1. 2026AI Watchdog: Agent Interfaces for Detecting and Defending Against Manipulative Dark Patterns in AI Conversationscited by 0
  2. 2026Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClawcited by 0
  3. 2026Before Acting, Change the State: Prospective State Intervention for Web Agents under Deceptive Interfacescited by 0
  4. 2026Who Keeps the Gains from Personal AI Assistants? Seller Adaptation and the Unassisted in a Language-Model Market Simulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents
  2. 2026Recognition, Simulation, and Refusal: A Contamination-Aware Study of Classic Psychological Effects in LLM Agents
  3. 2026A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents
  4. 2026Lighting Up or Dimming Down? Exploring Dark Patterns of LLMs in Co-Creativity
  5. 2026On the Suitability of LLM-Driven Agents for Dark Pattern Audits
  6. 2025LLMs as Deceptive Agents: How Role-Based Prompting Induces Semantic Ambiguity in Puzzle Tasks
  7. 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design
  8. 2025On the Regulatory Potential of User Interfaces for AI Agent Governance