LLMs and Childhood Safety: Identifying Risks and Proposing a Protection Framework for Safe Child-LLM Interaction
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Large Language Models (LLMs) are increasingly embedded in child-facing contexts such as education, companionship, creative tools, but their deployment raises safety, privacy, developmental, and security risks. We conduct a systematic literature review of child-LLM interaction risks and organize findings into a structured map that separates (i) parent-reported concerns, (ii) empirically documented harms, and (iii) gaps between perceived and observed risk. Moving beyond descriptive listing, we compare how different evidence streams in surveys, incident reports, youth interaction logs, and governance guidance operationalize "harm," where they conflict, and what mitigations they imply. Based on this synthesis, we propose a protection framework that couples child-specific content safety and developmental sensitivity with security-grade controls for adversarial misuse, including prompt injection and multimodal jailbreak pathways. The framework specifies measurable evaluation targets (e.g., harmful-content avoidance, age-calibrated readability, bias parity checks, prompt-injection robustness, and monitoring transparency) to support developers, educators, and policymakers in assessing and improving child-safe LLM deployments.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 13 of its 110 references that are in the map. First posted on arXiv 16 Feb 2025.
Builds on
13 of 110 references.
References · 13
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2024The Ethics of Advanced AI Assistantscited by 107
- 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 39
- 2024A Piece of Theatre: Investigating How Teachers Design LLM Chatbots to Assist Adolescent Cyberbullying Educationcited by 12
- 2024Can generative AI and ChatGPT outperform humans on cognitive-demanding problem-solving tasks in science?cited by 7
- 2023Towards social generative AI for education: theory, practices and ethicscited by 5
- 2024Multimodal Chain-of-Thought Reasoning via ChatGPT to Protect Children from Age-Inappropriate Appscited by 5
- 2024Distributed agency in second language learning and teaching through generative AIcited by 4
- 2024Helpful or Harmful? Exploring the Efficacy of Large Language Models for Online Grooming Preventioncited by 3
- 2024The Future of Child Development in the AI Era. Cross-Disciplinary Perspectives Between AI and Child Development Expertscited by 3
- 2024App Planner: Utilizing Generative AI in K-12 Mobile App Development Educationcited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoralcited by 14
- 2025MinorBench: A hand-built benchmark for content-based risks for childrencited by 9
- 2025Empowering Children to Create AI-Enabled Augmented Reality Experiencescited by 0
- 2025AutiHero: Engaging Parents in Creating Personalized, Multi-path Social Narratives for Autistic Childrencited by 0
- 2026The Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AIcited by 0
- 2026The Age of Curiosity Meets the Age of AI: Benchmarking Child Safety in Large Language Modelscited by 0
- 2026Understanding Parents' Complex Views of AI for Children's Pretend Playcited by 0
- 2026Understanding Parents' Complex Views of AI for Children's Pretend Play30 Sep 2026
- 2026The Age of Curiosity Meets the Age of AI: Benchmarking Child Safety in Large Language Models25 May 2026
- 2026The Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AI6 Jan 2026
- 2025AutiHero: Engaging Parents in Creating Personalized, Multi-path Social Narratives for Autistic Children22 Sep 2025
- 2025Empowering Children to Create AI-Enabled Augmented Reality Experiences11 Aug 2025
- 2025MinorBench: A hand-built benchmark for content-based risks for children13 Mar 2025
- 2025Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral19 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025LLM Safety for Children
- 2025Safe-Child-LLM: A Developmental Benchmark for Evaluating LLM Safety in Child-LLM Interactions
- 2025SproutBench: A Benchmark for Safe and Ethical Large Language Models for Youth
- 2026EduZone: A Framework for Evaluating LLM Safety for K-12 Students and Teachers
- 2026CR4T: Rewrite-Based Guardrails for Adolescent LLM Safety
- 2024Trust & Safety of LLMs and LLMs in Trust & Safety
- 2025Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLM
- 2025A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy