Disturbed YouTube for Kids: Characterizing and Detecting Inappropriate Videos Targeting Young Children
Not on the map. Why?
Abstract (arXiv)
A large number of the most-subscribed YouTube channels target children of a very young age. Hundreds of toddler-oriented channels on YouTube feature inoffensive, well-produced, and educational videos. Unfortunately, inappropriate content that targets this demographic is also common. YouTube's algorithmic recommendation system regrettably suggests inappropriate content because some of it mimics or is derived from otherwise appropriate content. Considering the risk for early childhood development, and an increasing trend in toddler's consumption of YouTube media, this is a worrisome problem. In this work, we build a classifier able to discern inappropriate content that targets toddlers on YouTube with 84.3% accuracy, and leverage it to perform a first-of-its-kind, large-scale, quantitative characterization that reveals some of the risks of YouTube media consumption by young children. Our analysis reveals that YouTube is still plagued by such disturbing videos and its currently deployed counter-measures are ineffective in terms of detecting them in a timely manner. Alarmingly, using our classifier we show that young children are not only able, but likely to encounter disturbing videos when they randomly browse the platform starting from benign videos.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 1; 2024: 2; 2025: 1; 2026: 3.
13 papers.
Sort:
By area:
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2024Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Modelscited by 13
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathwayscited by 5
- 2023Malicious or Benign? Towards Effective Content Moderation for Children's Videoscited by 5
- 2021Hate, Obscenity, and Insults: Measuring the Exposure of Children to Inappropriate Comments in YouTubecited by 4
- 2021VidHarm: A Clip Based Dataset for Harmful Content Detectioncited by 4
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusioncited by 4
- 2022'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTubecited by 3
- 2025SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformercited by 1
- 2022Privacy-Preserving Online Content Moderation: A Federated Learning Use Casecited by 0
- 2026Are Open-Weight LLMs Ready for Social Media Moderation? A Comparative Study on Blueskycited by 0
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approachcited by 0
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access28 Sep 2026
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approach2 Jun 2026
- 2026Are Open-Weight LLMs Ready for Social Media Moderation? A Comparative Study on Bluesky5 Feb 2026
- 2025SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer3 Jun 2025
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusion9 May 2024
- 2024Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Models27 Mar 2024
- 2023Malicious or Benign? Towards Effective Content Moderation for Children's Videos24 May 2023
- 2022Privacy-Preserving Online Content Moderation: A Federated Learning Use Case23 Sep 2022
- 2022A Comprehensive Survey on Trustworthy Recommender Systems21 Sep 2022
- 2022'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTube17 Feb 2022
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathways1 Feb 2022
- 2021VidHarm: A Clip Based Dataset for Harmful Content Detection15 Jun 2021
- 2025SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformercited by 1
- 2022Privacy-Preserving Online Content Moderation: A Federated Learning Use Casecited by 0
- 2026Are Open-Weight LLMs Ready for Social Media Moderation? A Comparative Study on Blueskycited by 0
- 2026Are Open-Weight LLMs Ready for Social Media Moderation? A Comparative Study on Bluesky5 Feb 2026
- 2025SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer3 Jun 2025
- 2022Privacy-Preserving Online Content Moderation: A Federated Learning Use Case23 Sep 2022
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2024Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Modelscited by 13
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathwayscited by 5
- 2023Malicious or Benign? Towards Effective Content Moderation for Children's Videoscited by 5
- 2021Hate, Obscenity, and Insults: Measuring the Exposure of Children to Inappropriate Comments in YouTubecited by 4
- 2021VidHarm: A Clip Based Dataset for Harmful Content Detectioncited by 4
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusioncited by 4
- 2022'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTubecited by 3
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approachcited by 0
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Accesscited by 0
- 2026N"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access28 Sep 2026
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approach2 Jun 2026
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusion9 May 2024
- 2024Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Models27 Mar 2024
- 2023Malicious or Benign? Towards Effective Content Moderation for Children's Videos24 May 2023
- 2022A Comprehensive Survey on Trustworthy Recommender Systems21 Sep 2022
- 2022'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTube17 Feb 2022
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathways1 Feb 2022
- 2021VidHarm: A Clip Based Dataset for Harmful Content Detection15 Jun 2021
- 2021Hate, Obscenity, and Insults: Measuring the Exposure of Children to Inappropriate Comments in YouTube3 Mar 2021