Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit
Not on the map. Why?
Abstract (arXiv)
Should social media platforms override a community's self-policing when it repeatedly break rules? What actions can they consider? In light of this debate, platforms have begun experimenting with softer alternatives to outright bans. We examine one such intervention called quarantining, that impedes direct access to and promotion of controversial communities. Specifically, we present two case studies of what happened when Reddit quarantined the influential communities r/TheRedPill (TRP) and r/The_Donald (TD). Using over 85M Reddit posts, we apply causal inference methods to examine the quarantine's effects on TRP and TD. We find that the quarantine made it more difficult to recruit new members: new user influx to TRP and TD decreased by 79.5% and 58%, respectively. Despite quarantining, existing users' misogyny and racism levels remained unaffected. We conclude by reflecting on the effectiveness of this design friction in limiting the influence of toxic communities and discuss broader implications for content moderation.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 3; 2024: 2; 2025: 3; 2026: 3.
16 papers.
Sort:
By area:
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
- 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbookcited by 25
- 2024Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluationcited by 15
- 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Mediacited by 10
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Redditcited by 5
- 2024Safeguarding Decentralized Social Media: LLM Agents for Automating Community Rule Compliancecited by 5
- 2021A Survey of Online Hate Speech through the Causal Lenscited by 2
- 2022Personalized Interventions for Online Moderationcited by 2
- 2022Quantifying How Hateful Communities Radicalize Online Userscited by 2
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsingcited by 2
- 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussionscited by 2
- 2022Hate speech, Censorship, and Freedom of Speech: The Changing Policies of Redditcited by 0
4 more
- 2025Queuing for Civility: Regulating Emotions and Reducing Toxicity in Digital Discoursecited by 0
- 2025Quantifying Feature Importance for Online Content Moderationcited by 0
- 2026Algorithmic Cultivation: How Social Media Feeds Shape User Languagecited by 0
- 2026Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeechcited by 0
- 2026Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech28 Jul 2026
- 2026Algorithmic Cultivation: How Social Media Feeds Shape User Language16 May 2026
- 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbook2 Feb 2026
- 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussions29 Oct 2025
- 2025Quantifying Feature Importance for Online Content Moderation22 Oct 2025
- 2025Queuing for Civility: Regulating Emotions and Reducing Toxicity in Digital Discourse31 Aug 2025
- 2024Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluation10 Dec 2024
- 2024Safeguarding Decentralized Social Media: LLM Agents for Automating Community Rule Compliance13 Sep 2024
- 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Media16 Dec 2023
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit18 Oct 2023
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsing21 May 2023
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning13 Dec 2022
4 more
- 2022Quantifying How Hateful Communities Radicalize Online Users19 Sep 2022
- 2022Personalized Interventions for Online Moderation19 May 2022
- 2022Hate speech, Censorship, and Freedom of Speech: The Changing Policies of Reddit18 Mar 2022
- 2021A Survey of Online Hate Speech through the Causal Lens16 Sep 2021
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
- 2024Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluationcited by 15
- 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Mediacited by 10
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Redditcited by 5
- 2021A Survey of Online Hate Speech through the Causal Lenscited by 2
- 2022Personalized Interventions for Online Moderationcited by 2
- 2022Quantifying How Hateful Communities Radicalize Online Userscited by 2
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsingcited by 2
- 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussionscited by 2
- 2022Hate speech, Censorship, and Freedom of Speech: The Changing Policies of Redditcited by 0
- 2025Queuing for Civility: Regulating Emotions and Reducing Toxicity in Digital Discoursecited by 0
- 2025Quantifying Feature Importance for Online Content Moderationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Contextualized Counterspeech Can Be More Persuasive Than Generic Counterspeech28 Jul 2026
- 2026Algorithmic Cultivation: How Social Media Feeds Shape User Language16 May 2026
- 2025The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussions29 Oct 2025
- 2025Quantifying Feature Importance for Online Content Moderation22 Oct 2025
- 2025Queuing for Civility: Regulating Emotions and Reducing Toxicity in Digital Discourse31 Aug 2025
- 2024Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluation10 Dec 2024
- 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Media16 Dec 2023
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit18 Oct 2023
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsing21 May 2023
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning13 Dec 2022
- 2022Quantifying How Hateful Communities Radicalize Online Users19 Sep 2022
- 2022Personalized Interventions for Online Moderation19 May 2022
12 newest of 14 All 14 (JSON)