mlsanityData to 7 Oct 2026

Evaluating LLM Safety Across Child Development Stages: A Simulated Agent Approach

arXiv 2510.05484 ↗First posted 7 Oct 2025cs.CYcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 2 more
Abstract (arXiv)

Current safety alignment for Large Language Models (LLMs) implicitly optimizes for a "modal adult user," leaving models vulnerable to distributional shifts in user cognition. We present ChildSafe, a benchmark that quantifies alignment robustness under cognitive shifts corresponding to four developmental stages. Unlike static persona-based evaluations, we introduce a parametric cognitive simulation approach, formalizing developmental stages as hyperparameter constraints (e.g., volatility, context horizon) to generate out-of-distribution interaction traces. We validate these agents against ground-truth human linguistic data (CHILDES) and deploy them across 1,200 multi-turn interactions. Our results reveal a systematic alignment generalization gap: state-of-the-art models exhibit up to 11.5% performance degradation when interacting with early-childhood agents compared to standard baselines. We provide the research community with the validated agent artifacts and evaluation protocols to facilitate robust alignment testing against non-adversarial, cognitively diverse populations.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 41 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

11 of 41 references.

References · 11

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  3. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  4. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  5. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  6. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  7. 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 401
  8. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 235
  9. 2023Safety Assessment of Chinese Large Language Modelscited by 82
  10. 2024LLMs Simulate Big Five Personality Traits: Further Evidencecited by 21
  11. 2023Personality testing of Large Language Models: Limited temporal stability, but highlighted prosocialitycited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026More Than 1v1: Human-AI Alignment in Early Developmental Communities with Multimodal LLMs
  2. 2026Can Safety Emerge from Weak Supervision? A Systematic Analysis of Small Language Models
  3. 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges
  4. 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation
  5. 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models
  6. 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agents
  7. 2026The Shadow Self: Intrinsic Value Misalignment in Large Language Model Agents
  8. 2024The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contexts