mlsanityData to 7 Oct 2026

A Privacy by Design Framework for Large Language Model-Based Applications for Children

arXiv 2602.17418 ↗First posted 19 Feb 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Children are increasingly using technologies powered by Artificial Intelligence (AI). However, there are growing concerns about privacy risks, particularly for children. Although existing privacy regulations require companies and organizations to implement protections, doing so can be challenging in practice. To address this challenge, this article proposes a framework based on Privacy-by-Design (PbD), which guides designers and developers to take on a proactive and risk-averse approach to technology design. Our framework includes principles from several privacy regulations, such as the General Data Protection Regulation (GDPR) from the European Union, the Personal Information Protection and Electronic Documents Act (PIPEDA) from Canada, and the Children's Online Privacy Protection Act (COPPA) from the United States. We map these principles to various stages of applications that use Large Language Models (LLMs), including data collection, model training, operational monitoring, and ongoing validation. For each stage, we discuss the operational controls found in the recent academic literature to help AI service providers and developers reduce privacy risks while meeting legal standards. In addition, the framework includes design guidelines for children, drawing from the United Nations Convention on the Rights of the Child (UNCRC), the UK's Age-Appropriate Design Code (AADC), and recent academic research. To demonstrate how this framework can be applied in practice, we present a case study of an LLM-based educational tutor for children under 13. Through our analysis and the case study, we show that by using data protection strategies such as technical and organizational controls and making age-appropriate design decisions throughout the LLM life cycle, we can support the development of AI applications for children that provide privacy protections and comply with legal requirements.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 128 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

50 of 128 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Deep Learning with Differential Privacycited by 2,682
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  5. 2020Extracting Training Data from Large Language Modelscited by 2,144
  6. 2018Datasheets for Datasetscited by 1,371
  7. 2018Model Cards for Model Reportingcited by 1,068
  8. 2019Machine Unlearningcited by 1,020
  9. 2021Ethical and social risks of harm from Language Modelscited by 957
  10. 2022Quantifying Memorization Across Neural Language Modelscited by 755
  11. 2023A Comprehensive Overview of Large Language Modelscited by 639
  12. 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
38 more
  1. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
  2. 2021Differentially Private Fine-tuning of Language Modelscited by 392
  3. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  4. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
  5. 2024Do Membership Inference Attacks Work on Large Language Models?cited by 188
  6. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
  7. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
  8. 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 146
  9. 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 137
  10. 2024Large Multimodal Agents: A Surveycited by 99
  11. 2019Analyzing Information Leakage of Updates to Natural Language Modelscited by 89
  12. 2022Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governancecited by 67
  13. 2023Right to be Forgotten in the Era of Large Language Models: Implications, Challenges, and Solutionscited by 59
  14. 2023Privacy Issues in Large Language Models: A Surveycited by 57
  15. 2024On Evaluating the Durability of Safeguards for Open-Weight LLMscited by 51
  16. 2022Structured access: an emerging paradigm for safe AI deploymentcited by 40
  17. 2022Privately Fine-Tuning Large Language Models with Differential Privacycited by 39
  18. 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methodscited by 38
  19. 2020Backdoor attacks and defenses in feature-partitioned collaborative learningcited by 30
  20. 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agentscited by 26
  21. 2024Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytellingcited by 21
  22. 2025A Survey on Privacy Risks and Protection in Large Language Modelscited by 20
  23. 2023Quantifying and Analyzing Entity-level Memorization in Large Language Modelscited by 18
  24. 2023Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountabilitycited by 16
  25. 2024Preserving Privacy in Large Language Models: A Survey on Current Threats and Solutionscited by 14
  26. 2021Systematic Literature Review of Validation Methods for AI Systemscited by 10
  27. 2025Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utilitycited by 9
  28. 2023"Alexa doesn't have that many feelings": Children's understanding of AI through interactions with smart speakers in their homescited by 8
  29. 2025Safe-Child-LLM: A Developmental Benchmark for Evaluating LLM Safety in Child-LLM Interactionscited by 7
  30. 2025Neglected Risks: The Disturbing Reality of Children's Images in Datasets and the Urgent Call for Accountabilitycited by 6
  31. 2024Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implicationscited by 5
  32. 2025Children's Mental Models of AI Reasoning: Implications for AI Literacy Educationcited by 5
  33. 2025Pruning Strategies for Backdoor Defense in LLMscited by 4
  34. 2019`I make up a silly name': Understanding Children's Perception of Privacy Risks Onlinecited by 3
  35. 2025A Manually Annotated Image-Caption Dataset for Detecting Children in the Wildcited by 2
  36. 2025PETLP: A Privacy-by-Design Pipeline for Social Media Data in AI Researchcited by 1
  37. 2025SoK: Data Minimization in Machine Learningcited by 1
  38. 2026Burn-After-Use for Preventing Data Leakage through a Secure Multi-Tenant Architecture in Enterprise LLMcited by 1

Built on by

Not cited yet.