AI Generated Child Sexual Abuse Material -- What's the Harm?
Not on the map. Why?
Abstract (arXiv)
The development of generative artificial intelligence (AI) tools capable of producing wholly or partially synthetic child sexual abuse material (AI CSAM) presents profound challenges for child protection, law enforcement, and societal responses to child exploitation. While some argue that the harmfulness of AI CSAM differs fundamentally from other CSAM due to a perceived absence of direct victimization, this perspective fails to account for the range of risks associated with its production and consumption. AI has been implicated in the creation of synthetic CSAM of children who have not previously been abused, the revictimization of known survivors of abuse, the facilitation of grooming, coercion and sexual extortion, and the normalization of child sexual exploitation. Additionally, AI CSAM may serve as a new or enhanced pathway into offending by lowering barriers to engagement, desensitizing users to progressively extreme content, and undermining protective factors for individuals with a sexual interest in children. This paper provides a primer on some key technologies, critically examines the harms associated with AI CSAM, and cautions against claims that it may function as a harm reduction tool, emphasizing how some appeals to harmlessness obscure its real risks and may contribute to inertia in ecosystem responses.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 5 of its 68 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
5 of 68 references.
References · 5
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2025Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMscited by 42
- 2023Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusioncited by 17
- 2025Deepfakes on Demand: the rise of accessible non-consensual deepfake image generatorscited by 15
- 2024Analyzing the AI Nudification Application Ecosystemcited by 10
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026A Marketplace for AI-Generated Adult Content and Deepfakescited by 1
- 2026Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliterationcited by 1
- 2025Getting Your Indices in a Row: Full-Text Search for LLM Training Data for Real Worldcited by 0
- 2026Position: Preventing AI-Generated CSAM Necessitates New Approaches to AI Safetycited by 0
- 2026Detecting CSAM Text-to-Image LoRAs From Weightscited by 0
- 2026Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliteration14 Sep 2026
- 2026Detecting CSAM Text-to-Image LoRAs From Weights28 Jul 2026
- 2026Position: Preventing AI-Generated CSAM Necessitates New Approaches to AI Safety9 Jun 2026
- 2026A Marketplace for AI-Generated Adult Content and Deepfakes14 Jan 2026
- 2025Getting Your Indices in a Row: Full-Text Search for LLM Training Data for Real World10 Oct 2025