Auditing Radicalization Pathways on YouTube
Not on the map. Why?
Abstract (arXiv)
Non-profits, as well as the media, have hypothesized the existence of a radicalization pipeline on YouTube, claiming that users systematically progress towards more extreme content on the platform. Yet, there is to date no substantial quantitative evidence of this alleged pipeline. To close this gap, we conduct a large-scale audit of user radicalization on YouTube. We analyze 330,925 videos posted on 349 channels, which we broadly classified into four types: Media, the Alt-lite, the Intellectual Dark Web (I.D.W.), and the Alt-right. According to the aforementioned radicalization hypothesis, channels in the I.D.W. and the Alt-lite serve as gateways to fringe far-right ideology, here represented by Alt-right channels. Processing 72M+ comments, we show that the three channel types indeed increasingly share the same user base; that users consistently migrate from milder to more extreme content; and that a large percentage of users who consume Alt-right content now consumed Alt-lite and I.D.W. content in the past. We also probe YouTube's recommendation algorithm, looking at more than 2M video and channel recommendations between May/July 2019. We find that Alt-lite content is easily reachable from I.D.W. channels, while Alt-right videos are reachable only through channel recommendations. Overall, we paint a comprehensive picture of user radicalization on YouTube.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 12; 2023: 5; 2024: 11; 2025: 4; 2026: 12.
53 papers.
Sort:
By area:
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2023Human-AI Coevolutioncited by 27
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
- 2021Problematic Machine Behavior: A Systematic Literature Review of Algorithm Auditscited by 21
- 2021Measuring Recommender System Effects with Simulated Userscited by 20
- 2022An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changescited by 15
- 2021T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systemscited by 12
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
38 more
- 2021Tournesol: A quest for a large, secure and trustworthy database of reliable human judgmentscited by 11
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
- 2024Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendationscited by 11
- 2022Algorithmic audits of algorithms, and the lawcited by 9
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2021Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachabilitycited by 8
- 2022Towards Psychologically-Grounded Dynamic Preference Modelscited by 8
- 2022Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubblescited by 8
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotatorscited by 8
- 2023Modeling Recommender Ecosystems: Research Challenges at the Intersection of Mechanism Design, Reinforcement Learning and Generative Modelscited by 7
- 2024A call for embodied AIcited by 7
- 2024Addressing the regulatory gap: moving towards an EU AI audit ecosystem beyond the AI Act by including civil societycited by 7
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathwayscited by 6
- 2024Harm Mitigation in Recommender Systems under User Preference Dynamicscited by 5
- 2024Algorithmic Drift: A Simulation Framework to Study the Effects of Recommender Systems on User Preferencescited by 5
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2023Upvotes? Downvotes? No Votes? Understanding the relationship between reaction mechanisms and political discourse on Redditcited by 3
- 2025MythTriage: Scalable Detection of Opioid Use Disorder Myths on a Video-Sharing Platformcited by 3
- 2021Modeling Language Usage and Listener Engagement in Podcastscited by 2
- 2021Predicting the Factuality of Reporting of News Media Using Observations About User Attention in Their YouTube Channelscited by 2
- 2024A Novel BERT-based Classifier to Detect Political Leaning of YouTube Videos based on their Titlescited by 2
- 2024System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processescited by 2
- 2025Dynamics of Algorithmic Content Amplification on TikTokcited by 2
- 2025Datasets for Navigating Sensitive Topics in Recommendation Systemscited by 2
- 2023Reducing Exposure to Harmful Content via Graph Rewiringcited by 1
- 2024Algorithmic Behaviors Across Regions: A Geolocation Audit of YouTube Search for COVID-19 Misinformation Between the United States and South Africacited by 1
- 2026Gendered Pathways in AI Companionship: Cross-Community Behavior and Toxicity Patterns on Redditcited by 1
- 2026The DSA's Blind Spot: Algorithmic Audit of Advertising and Minor Profiling on TikTokcited by 1
- 2026Solipsistic Superintelligence is Unlikely to be Cooperativecited by 1
- 2021An influencer-based approach to understanding radical right viral tweetscited by 0
- 2022Understanding or Manipulation: Rethinking Online Performance Gains of Modern Recommender Systemscited by 0
- 2025MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkerscited by 0
- 2026Examining the Role of YouTube Production and Consumption Dynamics on the Formation of Extreme Ideologiescited by 0
- 2026DariMis: Harm-Aware Modeling for Dari Misinformation Detection on YouTubecited by 0
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approachcited by 0
- 2026Instrumental convergence and power-seekingcited by 0
- 2026Architectural Wisdom: A Framework for Governing Optimization in AI Systemscited by 0
- 2026Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scalecited by 0
50 most cited of 53 All 53 (JSON)
- 2026Why Does Misinformation Propagate Faster? An Algorithmic Perspective on X24 Sep 2026
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026FacetCRS: Multi-Faceted Preference Learning for Pricking Filter Bubbles in Conversational Recommender System24 Jul 2026
- 2026Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scale29 Jun 2026
- 2026Architectural Wisdom: A Framework for Governing Optimization in AI Systems15 Jun 2026
- 2026Instrumental convergence and power-seeking7 Jun 2026
- 2026Solipsistic Superintelligence is Unlikely to be Cooperative2 Jun 2026
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approach2 Jun 2026
- 2026DariMis: Harm-Aware Modeling for Dari Misinformation Detection on YouTube24 Mar 2026
- 2026Examining the Role of YouTube Production and Consumption Dynamics on the Formation of Extreme Ideologies9 Mar 2026
- 2026The DSA's Blind Spot: Algorithmic Audit of Advertising and Minor Profiling on TikTok5 Mar 2026
- 2026Gendered Pathways in AI Companionship: Cross-Community Behavior and Toxicity Patterns on Reddit3 Jan 2026
38 more
- 2025Datasets for Navigating Sensitive Topics in Recommendation Systems8 Sep 2025
- 2025MythTriage: Scalable Detection of Opioid Use Disorder Myths on a Video-Sharing Platform30 May 2025
- 2025MetaHarm: Harmful YouTube Video Dataset Annotated by Domain Experts, GPT-4-Turbo, and Crowdworkers22 Apr 2025
- 2025Dynamics of Algorithmic Content Amplification on TikTok26 Mar 2025
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators6 Nov 2024
- 2024On Goodhart's law, with an application to value alignment12 Oct 2024
- 2024Algorithmic Drift: A Simulation Framework to Study the Effects of Recommender Systems on User Preferences24 Sep 2024
- 2024Algorithmic Behaviors Across Regions: A Geolocation Audit of YouTube Search for COVID-19 Misinformation Between the United States and South Africa16 Sep 2024
- 2024Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations7 Aug 2024
- 2024Harm Mitigation in Recommender Systems under User Preference Dynamics14 Jun 2024
- 2024System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes29 May 2024
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfaces17 Apr 2024
- 2024Addressing the regulatory gap: moving towards an EU AI audit ecosystem beyond the AI Act by including civil society26 Feb 2024
- 2024A Novel BERT-based Classifier to Detect Political Leaning of YouTube Videos based on their Titles16 Feb 2024
- 2024A call for embodied AI6 Feb 2024
- 2023Modeling Recommender Ecosystems: Research Challenges at the Intersection of Mechanism Design, Reinforcement Learning and Generative Models8 Sep 2023
- 2023Human-AI Coevolution23 Jun 2023
- 2023Reducing Exposure to Harmful Content via Graph Rewiring5 Jun 2023
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
- 2023Upvotes? Downvotes? No Votes? Understanding the relationship between reaction mechanisms and political discourse on Reddit19 Feb 2023
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning13 Dec 2022
- 2022Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles18 Oct 2022
- 2022Understanding or Manipulation: Rethinking Online Performance Gains of Modern Recommender Systems11 Oct 2022
- 2022A Comprehensive Survey on Trustworthy Recommender Systems21 Sep 2022
- 2022Towards Psychologically-Grounded Dynamic Preference Models1 Aug 2022
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systems9 May 2022
- 2022An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changes25 Mar 2022
- 2022Algorithmic audits of algorithms, and the law15 Feb 2022
- 2022Rewiring What-to-Watch-Next Recommendations to Reduce Radicalization Pathways1 Feb 2022
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models10 Jan 2022
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound7 Jan 2022
- 2021An influencer-based approach to understanding radical right viral tweets15 Sep 2021
- 2021Predicting the Factuality of Reporting of News Media Using Observations About User Attention in Their YouTube Channels27 Aug 2021
- 2021T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systems19 Jul 2021
- 2021Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachability30 Jun 2021
- 2021Modeling Language Usage and Listener Engagement in Podcasts11 Jun 2021
- 2021MERLOT: Multimodal Neural Script Knowledge Models4 Jun 2021
50 newest of 53 All 53 (JSON)
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2023Harms from Increasingly Agentic Algorithmic Systems20 Feb 2023
- 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2023Human-AI Coevolutioncited by 27
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
- 2021Problematic Machine Behavior: A Systematic Literature Review of Algorithm Auditscited by 21
- 2021Measuring Recommender System Effects with Simulated Userscited by 20
- 2022An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changescited by 15
- 2021T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systemscited by 12
- 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
- 2021Tournesol: A quest for a large, secure and trustworthy database of reliable human judgmentscited by 11
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
12 most cited of 49 All 49 (JSON)
- 2026Why Does Misinformation Propagate Faster? An Algorithmic Perspective on X24 Sep 2026
- 2026ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation30 Aug 2026
- 2026FacetCRS: Multi-Faceted Preference Learning for Pricking Filter Bubbles in Conversational Recommender System24 Jul 2026
- 2026Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scale29 Jun 2026
- 2026Architectural Wisdom: A Framework for Governing Optimization in AI Systems15 Jun 2026
- 2026Instrumental convergence and power-seeking7 Jun 2026
- 2026Solipsistic Superintelligence is Unlikely to be Cooperative2 Jun 2026
- 2026Auditing Engagement Incentives in the Kidfluencer Ecosystem: A Multimodal Weak Supervision Approach2 Jun 2026
- 2026DariMis: Harm-Aware Modeling for Dari Misinformation Detection on YouTube24 Mar 2026
- 2026Examining the Role of YouTube Production and Consumption Dynamics on the Formation of Extreme Ideologies9 Mar 2026
- 2026The DSA's Blind Spot: Algorithmic Audit of Advertising and Minor Profiling on TikTok5 Mar 2026
- 2026Gendered Pathways in AI Companionship: Cross-Community Behavior and Toxicity Patterns on Reddit3 Jan 2026
12 newest of 49 All 49 (JSON)