Auditing Exposure to Harmful Content on TikTok using Multimodal Language Models: A Cross-National, Age-Stratified Study
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Online video platforms can expose young users to harmful content, but independent audits remain difficult because video annotation is costly and moderation judgments vary across languages. We audit TikTok in France, Italy, and Sweden with sockpuppet accounts representing four age personas (13, 16, 19, 40), collecting 36,971 videos from passive For-You-page scrolling and active sessions that scroll, search for harm keywords, and scroll again. To scale annotation, we validate four multimodal LLMs against native-speaker labels on a 300-video reference set. Gemini 2.5 Flash with eight sampled frames plus text performs best (aggregate kappa = 0.42), at half the per-call cost of native-video upload, and we apply it to a 10% sample for approximately 50 in total API spend across both modalities. Keyword search returns 35-56% harmful content, a 1.5-7.5x increase over the scrolling baseline in ten of twelve country-age combinations; the spike is temporary and flattens the age differences observed in France and Sweden. Under passive scrolling, Italy has the highest harm rate at every age, with Italian age-19 reaching 48.6%. Overall, MLLM-based auditing offers a scalable approach for cross-national youth-safety audits, while provider safety filters (1.1% refusal rate) under-count the most explicit harms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 8 of its 33 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
8 of 33 references.
Closest ancestors · 1
Same direction, newest first
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators6 Nov
Other references · 7
- 2024Content Moderation by LLM: From Accuracy to Legitimacycited by 30
- 2025Breaking Down Video LLM Benchmarks: Knowledge, Spatial Perception, or True Temporal Understanding?cited by 20
- 2024ICM-Assistant: Instruction-tuning Multimodal Large Language Models for Rule-based Explainable Image Content Moderationcited by 11
- 2022An Empirical Investigation of Personalization Factors on TikTokcited by 9
- 2025Dynamics of Algorithmic Content Amplification on TikTokcited by 2
- 2025Towards an Automated Framework to Audit Youth Safety on TikTokcited by 2
- 2025AutoLike: Auditing Social Media Recommendations through User Interactionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Catching Dark Signals in Algorithms: Unveiling Audiovisual and Thematic Markers of Unsafe Content Recommended for Children and Teenagers
- 2025Protecting Young Users on Social Media: Evaluating the Effectiveness of Content Moderation and Legal Safeguards on Video Sharing Platforms
- 2025MTikGuard System: A Transformer-Based Multimodal System for Child-Safe Content Moderation on TikTok
- 2026When Youth Enter the Algorithmic Wild: Discovering and Understanding Potentially Harmful Teen Videos on Douyin and Kwai
- 2025BigTokDetect: A Clinically-Informed Vision-Language Modeling Framework for Detecting Pro-Bigorexia Videos on TikTok
- 2025MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkers
- 2026Seeking Help, Facing Harm: Auditing TikTok's Mental Health Recommendations ↗
- 2025Towards Safer Social Media Platforms: Scalable and Performant Few-Shot Harmful Content Moderation Using Large Language Models