mlsanityData to 14 Oct 2026

When Youth Enter the Algorithmic Wild: Discovering and Understanding Potentially Harmful Teen Videos on Douyin and Kwai

arXiv 2605.23598 ↗First posted 22 May 2026cs.CR cs.HCcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Short-video platforms like Douyin and Kwai have become central to adolescent digital life, but they also risk exposing teens to algorithmically amplified harmful content. Despite its societal importance, the scale, mechanisms, and real-world impact of this exposure remain poorly understood. Measuring it is challenging: recommendation feeds are personalized black boxes, harmful content employs sophisticated evasion tactics, and naive crawlers fail to replicate authentic teen behavior. To bridge this gap, we propose PHTV-Scout, the first large-scale, behaviorally grounded measurement framework for Potentially Harmful Teen Videos (PHTVs). We integrate an offline survey of 683 adolescents with a tri-module online pipeline: (1) PHTV Hunter simulates teen accounts to collect recommendation feeds; (2) PHTV Arbiter, a LoRA-finetuned multimodal classifier, detects PHTVs with 94.29% accuracy and 96.41% precision; and (3) PHTV Analyzer performs fine-grained categorization and impact assessment. Over six months, we analyzed 186,727 videos and 51,287 comments, uncovering a troubling 6.11% PHTV prevalence--dominated by Child Sexual Exploitation Imagery (53.2%)--and revealing that harmful content thrives through covert interactions (e.g., grooming comments, self-disclosure) and active evasion (semantic camouflage, noise injection). Crucially, while Youth Mode blocks 100% of PHTVs, its low adoption (30-41%) leaves most teens unprotected. We further show that exposure is driven not by user identity but by regulation, platform algorithms, and even passive browsing, exposing the fragility of adolescent information environments. Our findings call for a paradigm shift from reactive takedowns to proactive, human-centered safeguards.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 19 of its 44 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

19 of 44 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators6 Nov
  2. 2024Supporting Human Raters with the Detection of Harmful Content using Large Language Models18 Jun

Other references · 17

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  3. 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 231
  4. 2024In-Context Learning with Long-Context Models: An In-Depth Explorationcited by 128
  5. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  6. 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 96
  7. 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 86
  8. 2024Many-Shot In-Context Learning in Multimodal Foundation Modelscited by 67
  9. 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 46
  10. 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 42
  11. 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 39
  12. 2018Convolutional Neural Networks for Toxic Comment Classificationcited by 24
5 more
  1. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Modelscited by 18
  2. 2022An Empirical Investigation of Personalization Factors on TikTokcited by 9
  3. 2025Dynamics of Algorithmic Content Amplification on TikTokcited by 2
  4. 2024Detecting and Understanding the Promotion of Illicit Goods and Services on Twittercited by 1
  5. 2025MTikGuard System: A Transformer-Based Multimodal System for Child-Safe Content Moderation on TikTokcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Catching Dark Signals in Algorithms: Unveiling Audiovisual and Thematic Markers of Unsafe Content Recommended for Children and Teenagers
  2. 2026Auditing Exposure to Harmful Content on TikTok using Multimodal Language Models: A Cross-National, Age-Stratified Study
  3. 2025Towards an Automated Framework to Audit Youth Safety on TikTok
  4. 2025MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkers
  5. 2026Seeking Help, Facing Harm: Auditing TikTok's Mental Health Recommendations ↗
  6. 2025Protecting Young Users on Social Media: Evaluating the Effectiveness of Content Moderation and Legal Safeguards on Video Sharing Platforms
  7. 2026Child-Oriented AIGC Video Risk Reviewing: A Benchmark and Knowledge-Supported Iterative Reasoning Framework
  8. 2025YouTube Recommendations Reinforce Negative Emotions: Auditing Algorithmic Bias with Emotionally-Agentic Sock Puppets