Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Labor
Not on the map. Why?
Abstract (arXiv)
Social media platforms moderate content for each user by incorporating the outputs of both platform-wide content moderation systems and, in some cases, user-configured personal moderation preferences. However, it is unclear (1) how end users perceive the choices and affordances of different kinds of personal content moderation tools, and (2) how the introduction of personalization impacts user perceptions of platforms' content moderation responsibilities. This paper investigates end users' perspectives on personal content moderation tools by conducting an interview study with a diverse sample of 24 active social media users. We probe interviewees' preferences using simulated personal moderation interfaces, including word filters, sliders for toxicity levels, and boolean toxicity toggles. We also examine the labor involved for users in choosing moderation settings and present users' attitudes about the roles and responsibilities of social media platforms and other stakeholders towards moderation. We discuss how our findings can inform design solutions to improve transparency and controllability in personal content moderation tools.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 May 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 7; 2025: 4; 2026: 7.
18 papers.
Sort:
By area:
- 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulationscited by 27
- 2024Venire: A Machine Learning-Guided Panel Review System for Community Content Moderationcited by 7
- 2024Steering AI-Driven Personalization of Scientific Text for General Audiencescited by 7
- 2024MisinfoEval: Generative AI in the Era of "Alternative Facts"cited by 6
- 2024Supporting Human Raters with the Detection of Harmful Content using Large Language Modelscited by 5
- 2024AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detectioncited by 4
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformationcited by 4
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2024Mitigating Text Toxicity with Counterfactual Generationcited by 2
- 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systemscited by 2
- 2024Safe Generative Chats in a WhatsApp Intelligent Tutoring Systemcited by 0
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderationcited by 0
6 more
- 2026Age Matters: Analyzing Age-Related Discussions in App Reviewscited by 0
- 2026IYKYK (But AI Doesn't): Automated Content Moderation Does Not Capture Communities' Heterogeneous Attitudes Towards Reclaimed Languagecited by 0
- 2026Transparent and Controllable Recommendation Filtering via Multimodal Multi-Agent Collaborationcited by 0
- 2026Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Frameworkcited by 0
- 2026When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shortscited by 0
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflectionscited by 0
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflections4 Aug 2026
- 2026Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Framework2 May 2026
- 2026When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shorts30 Apr 2026
- 2026Transparent and Controllable Recommendation Filtering via Multimodal Multi-Agent Collaboration19 Apr 2026
- 2026IYKYK (But AI Doesn't): Automated Content Moderation Does Not Capture Communities' Heterogeneous Attitudes Towards Reclaimed Language17 Apr 2026
- 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systems30 Mar 2026
- 2026Age Matters: Analyzing Age-Related Discussions in App Reviews29 Jan 2026
- 2025Value Alignment of Social Media Ranking Algorithms17 Sep 2025
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation8 Jun 2025
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation31 May 2025
- 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulations10 Apr 2025
- 2024Steering AI-Driven Personalization of Scientific Text for General Audiences15 Nov 2024
6 more
- 2024Venire: A Machine Learning-Guided Panel Review System for Community Content Moderation30 Oct 2024
- 2024MisinfoEval: Generative AI in the Era of "Alternative Facts"13 Oct 2024
- 2024Safe Generative Chats in a WhatsApp Intelligent Tutoring System6 Jul 2024
- 2024Supporting Human Raters with the Detection of Harmful Content using Large Language Models18 Jun 2024
- 2024AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detection12 Jun 2024
- 2024Mitigating Text Toxicity with Counterfactual Generation16 May 2024
- 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulationscited by 27
- 2026Transparent and Controllable Recommendation Filtering via Multimodal Multi-Agent Collaborationcited by 0
- 2026Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Frameworkcited by 0
- 2026Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Framework2 May 2026
- 2026Transparent and Controllable Recommendation Filtering via Multimodal Multi-Agent Collaboration19 Apr 2026
- 2025MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulations10 Apr 2025
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2025Value Alignment of Social Media Ranking Algorithms17 Sep 2025
- 2024Venire: A Machine Learning-Guided Panel Review System for Community Content Moderationcited by 7
- 2024Steering AI-Driven Personalization of Scientific Text for General Audiencescited by 7
- 2024MisinfoEval: Generative AI in the Era of "Alternative Facts"cited by 6
- 2024AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detectioncited by 4
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformationcited by 4
- 2024Mitigating Text Toxicity with Counterfactual Generationcited by 2
- 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systemscited by 2
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderationcited by 0
- 2026Age Matters: Analyzing Age-Related Discussions in App Reviewscited by 0
- 2026IYKYK (But AI Doesn't): Automated Content Moderation Does Not Capture Communities' Heterogeneous Attitudes Towards Reclaimed Languagecited by 0
- 2026When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shortscited by 0
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflectionscited by 0
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflections4 Aug 2026
- 2026When Jokes Cross the Line: Analyzing Regular Humor and Dark Humor in YouTube Shorts30 Apr 2026
- 2026IYKYK (But AI Doesn't): Automated Content Moderation Does Not Capture Communities' Heterogeneous Attitudes Towards Reclaimed Language17 Apr 2026
- 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systems30 Mar 2026
- 2026Age Matters: Analyzing Age-Related Discussions in App Reviews29 Jan 2026
- 2025Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation8 Jun 2025
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation31 May 2025
- 2024Steering AI-Driven Personalization of Scientific Text for General Audiences15 Nov 2024
- 2024Venire: A Machine Learning-Guided Panel Review System for Community Content Moderation30 Oct 2024
- 2024MisinfoEval: Generative AI in the Era of "Alternative Facts"13 Oct 2024
- 2024AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detection12 Jun 2024
- 2024Mitigating Text Toxicity with Counterfactual Generation16 May 2024