Spillover of Antisocial Behavior from Fringe Platforms: The Unintended Consequences of Community Banning
Not on the map. Why?
Abstract (arXiv)
Online platforms face pressure to keep their communities civil and respectful. Thus, the bannings of problematic online communities from mainstream platforms like Reddit and Facebook are often met with enthusiastic public reactions. However, this policy can lead users to migrate to alternative fringe platforms with lower moderation standards and where antisocial behaviors like trolling and harassment are widely accepted. As users of these communities often remain co-active across mainstream and fringe platforms, antisocial behaviors may spill over onto the mainstream platform. We study this possible spillover by analyzing around 70,000 users from three banned communities that migrated to fringe platforms: r/The_Donald, r/GenderCritical, and r/Incels. Using a difference-in-differences design, we contrast co-active users with matched counterparts to estimate the causal effect of fringe platform participation on users' antisocial behavior on Reddit. Our results show that participating in the fringe communities increases users' toxicity on Reddit (as measured by Perspective API) and involvement with subreddits similar to the banned community -- which often also breach platform norms. The effect intensifies with time and exposure to the fringe platform. In short, we find evidence for a spillover of antisocial behavior from fringe platforms onto Reddit via co-participation.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 18 of its 77 references that are in the map. First posted on arXiv 20 Sep 2022.
Builds on
18 of 77 references.
References · 18
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2020The Pushshift Reddit Datasetcited by 289
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
- 2018On the Origins of Memes by Means of Fringe Web Communitiescited by 45
- 2017Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussionscited by 30
- 2020Quantifying social organization and political polarization in online platformscited by 30
- 2020Control, Generate, Augment: A Scalable Framework for Multi-Attribute Text Generationcited by 18
- 2015Antisocial Behavior in Online Discussion Communitiescited by 16
- 2020Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incelscited by 15
- 2022Make Reddit Great Again: Assessing Community Effects of Moderation Interventions on r/The_Donaldcited by 13
- 2020Measuring and Characterizing Hate Speech on News Websitescited by 12
- 2017The Web Centipede: Understanding How Web Communities Influence Each Other Through the Lens of Mainstream and Alternative News Sourcescited by 11
6 more
- 2022Pathways through Conspiracy: The Evolution of Conspiracy Radicalization through Engagement in Online Conspiracy Discussionscited by 8
- 2019From Welcome New Gabbers to the Pittsburgh Synagogue Shooting: The Evolution of Gabcited by 5
- 2018Mobilizing the Trump Train: Understanding Collective Action in a Political Trolling Communitycited by 4
- 2021Comparing the Language of QAnon-related content on Parler, Gab, and Twittercited by 4
- 2022Disentangling Active and Passive Cosponsorship in the U.S. Congresscited by 4
- 2021Soros, Child Sacrifices, and 5G: Understanding the Spread of Conspiracy Theories on Web Communitiescited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 3; 2025: 4; 2026: 2.
14 papers.
Sort:
- 2023People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detectioncited by 25
- 2025Valid Survey Simulations with Limited Human Data: The Roles of Prompting, Fine-Tuning, and Rectificationcited by 17
- 2025The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Modelscited by 7
- 2022Understanding Online Migration Decisions Following the Banning of Radical Communitiescited by 6
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Redditcited by 5
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech datasetcited by 5
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMscited by 4
- 2023ACTI at EVALITA 2023: Overview of the Conspiracy Theory Identification Taskcited by 2
- 2024Structure and dynamics of growing networks of Reddit threadscited by 2
- 2025Meat-Free Day Reduces Greenhouse Gas Emissions but Poses Challenges for Customer Retention and Adherence to Dietary Guidelinescited by 2
- 2023UPB @ ACTI: Detecting Conspiracies using fine tuned Sentence Transformerscited by 0
- 2025Carrot, stick, or both? Price incentives for sustainable food choice in competitive environmentscited by 0
- 2026From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM20 Sep 2026
- 2026Beyond the Rabbit Hole: Mapping the Relational Harms of QAnon Radicalization25 Jan 2026
- 2025Carrot, stick, or both? Price incentives for sustainable food choice in competitive environments15 Dec 2025
- 2025Valid Survey Simulations with Limited Human Data: The Roles of Prompting, Fine-Tuning, and Rectification13 Oct 2025
- 2025The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Models23 Jul 2025
- 2025Meat-Free Day Reduces Greenhouse Gas Emissions but Poses Challenges for Customer Retention and Adherence to Dietary Guidelines2 Apr 2025
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMs28 Oct 2024
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech dataset2 Oct 2024
- 2024Structure and dynamics of growing networks of Reddit threads6 Sep 2024
- 2023People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection2 Nov 2023
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit18 Oct 2023
- 2023UPB @ ACTI: Detecting Conspiracies using fine tuned Sentence Transformers28 Sep 2023
- 2023People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detectioncited by 25
- 2025Valid Survey Simulations with Limited Human Data: The Roles of Prompting, Fine-Tuning, and Rectificationcited by 17
- 2025The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Modelscited by 7
- 2022Understanding Online Migration Decisions Following the Banning of Radical Communitiescited by 6
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Redditcited by 5
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech datasetcited by 5
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMscited by 4
- 2023ACTI at EVALITA 2023: Overview of the Conspiracy Theory Identification Taskcited by 2
- 2024Structure and dynamics of growing networks of Reddit threadscited by 2
- 2025Meat-Free Day Reduces Greenhouse Gas Emissions but Poses Challenges for Customer Retention and Adherence to Dietary Guidelinescited by 2
- 2023UPB @ ACTI: Detecting Conspiracies using fine tuned Sentence Transformerscited by 0
- 2025Carrot, stick, or both? Price incentives for sustainable food choice in competitive environmentscited by 0
12 most cited of 14 All 14 (JSON)
- 2026From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM20 Sep 2026
- 2026Beyond the Rabbit Hole: Mapping the Relational Harms of QAnon Radicalization25 Jan 2026
- 2025Carrot, stick, or both? Price incentives for sustainable food choice in competitive environments15 Dec 2025
- 2025Valid Survey Simulations with Limited Human Data: The Roles of Prompting, Fine-Tuning, and Rectification13 Oct 2025
- 2025The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Models23 Jul 2025
- 2025Meat-Free Day Reduces Greenhouse Gas Emissions but Poses Challenges for Customer Retention and Adherence to Dietary Guidelines2 Apr 2025
- 2024Estimating Causal Effects of Text Interventions Leveraging LLMs28 Oct 2024
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech dataset2 Oct 2024
- 2024Structure and dynamics of growing networks of Reddit threads6 Sep 2024
- 2023People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection2 Nov 2023
- 2023Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit18 Oct 2023
- 2023UPB @ ACTI: Detecting Conspiracies using fine tuned Sentence Transformers28 Sep 2023
12 newest of 14 All 14 (JSON)