Deception at Scale: Deceptive Designs in 1K LLM-Generated Ecommerce Components
Not on the map. Why?
Abstract (arXiv)
Recent work has shown that front-end code generated by Large Language Models (LLMs) can embed deceptive designs. To assess the magnitude of this problem, identify the factors that influence deceptive design production, and test strategies for reducing deceptive designs, we carried out two studies which generated and analyzed 1,296 LLM-generated web components, along with a design rationale for each. The first study tested four LLMs for 15 common ecommerce components. Overall 55.8% of components contained at least one deceptive design, and 30.6% contained two or more. Occurence varied significantly across models, with DeepSeek-V3 producing the fewest. Interface interference emerged as the dominant strategy, using color psychology to influence actions and hiding essential information. The first study found that prompts emphasizing business interests (e.g., increasing sales) significantly increased deceptive designs, so a second study tested a variety of prompting strategies to reduce their frequency, finding a values-centered approach the most effective. Our findings highlight risks in using LLMs for coding and offer recommendations for LLM developers and providers.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 85 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
18 of 85 references.
References · 18
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
- 2023Using an LLM to Help With Code Understandingcited by 222
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 186
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2023Deception Abilities Emerged in Large Language Modelscited by 99
- 2022Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Bookcited by 84
- 2023Moral Foundations of Large Language Modelscited by 84
- 2023A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challengescited by 75
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2019Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websitescited by 18
- 2021What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methodscited by 15
6 more
- 2023An Ontology of Dark Patterns Knowledge: Foundations, Definitions, and a Pathway for Shared Knowledge-Buildingcited by 14
- 2021I am Definitely Manipulated, Even When I am Aware of it. It s Ridiculous! -- Dark Patterns from the End-User Perspectivecited by 8
- 2024Unveiling and Manipulating Prompt Influence in Large Language Modelscited by 6
- 2023Defending Against the Dark Arts: Recognising Dark Patterns in Social Mediacited by 5
- 2024"Create a Fear of Missing Out" -- ChatGPT Implements Unsolicited Deceptive Designs in Generated Websites Without Warningcited by 5
- 2023About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Servicescited by 3
Built on by
Not cited yet.