Focused on the User, Overlooking the Risks: Security and Privacy Understandings, Practices and Challenges of Independent Chinese AI Agent Developers
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The proliferation of AI agents empowers independent developers, defined as individual or small groups who self-initiate projects rather than fulfill client-based contracts, to create sophisticated autonomous systems, but also introduces novel security and privacy (S&P) challenges beyond traditional corporate structures. We conducted an interview study (N=28) with Chinese developers, whose extensive use of global LLM services offer valuable insights into this population. We investigate their understandings, practices and challenges of S&P challenges in their developed AI agent products. We revealed that independent developers frequently think and act from their users' perspective. They focused on user-facing safety risks such as harmful content while exhibiting low awareness of security vulnerabilities. Consequently, developers rely almost exclusively on ad-hoc, manually crafted safeguards and informal communication, with an absence of formal tools or processes for S&P practices. We found these actions are driven by various inhibitors, primarily a lack of formal training on S&P related skills, accessible security tools and actionable guidance from platforms. Our work contributed the first exploration of independent AI agent developers' S&P understanding, outlining opportunities for tailored security tooling.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 111 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
16 of 111 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
- 2020Adversarial Machine Learning -- Industry Perspectivescited by 122
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2025Understanding Users' Security and Privacy Concerns and Attitudes Towards Conversational AI Platformscited by 9
- 2025PrivWeb: Unobtrusive and Content-aware Privacy Protection For Web Agentscited by 9
- 2024Development in times of hype: How freelancers explore Generative AI?cited by 8
- 2024Adanonymizer: Interactively Navigating and Balancing the Duality of Privacy and Output Performance in Human-LLM Interactioncited by 6
- 2025Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memorycited by 6
- 2023Cooperation in the Gig Economy: Insights from Upwork Freelancerscited by 3
- 2021Compliance Requirements in Large-Scale Software Development: An Industrial Case Studycited by 2
- 2025"We are not Future-ready": Understanding AI Privacy Risks and Existing Mitigation Strategies from the Perspective of AI Developers in Europecited by 2
- 2023Security in Online Freelance Software Development: A case for Distributed Security Responsibilitycited by 1
3 more
- 2024Defying the Odds: Solana's Unexpected Resilience in Spite of the Security Challenges Faced by Developerscited by 1
- 2025"Sorry for bugging you so much." Exploring Developers' Behavior Towards Privacy-Compliant Implementationcited by 1
- 2025Privacy Perspectives and Practices of Chinese Smart Home Product Teamscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Perils of Agency: How Developers Perceive, Prioritize, and Address Risks in Agentic AI Products
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
- 2026Security in the Age of AI Teammates: An Empirical Study of Agentic Pull Requests on GitHub
- 2026Reframing LLM Agent Security as an Agent-Human Interaction Problem
- 2025Security practices in AI development
- 2026Toward Securing AI Agents Like Operating Systems
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis
- 2024Security of AI Agents