# Emotionally Aware Moderation: The Potential of Emotion Monitoring in Shaping Healthier Social Media Conversations

arXiv: https://arxiv.org/abs/2507.21089 · HTML: https://mlsanity.com/paper/2507.21089/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 93 references that are in the map.
- First posted on arXiv 24 Jun 2025.

## Builds on (most cited first, 14 of 14)

- [Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer](https://mlsanity.com/paper/1910.10683/) (2019)
- [TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification](https://mlsanity.com/paper/2010.12421/) (2020)
- [HateBERT: Retraining BERT for Abusive Language Detection in English](https://mlsanity.com/paper/2010.12472/) (2020)
- ["Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction](https://mlsanity.com/paper/2210.03735/) (2022)
- [Hate Lingo: A Target-based Linguistic Analysis of Hate Speech in Social Media](https://mlsanity.com/paper/1804.04257/) (2018)
- [A Systematic Literature Review of User Trust in AI-Enabled Systems: An HCI Perspective](https://mlsanity.com/paper/2304.08795/) (2023)
- [Defining and Detecting Toxicity on Social Media: Context and Knowledge are Key](https://mlsanity.com/paper/2104.10788/) (2021)
- [Proactive Moderation of Online Discussions: Existing Practices and the Potential for Algorithmic Support](https://mlsanity.com/paper/2211.16525/) (2022)
- [Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation](https://mlsanity.com/paper/1711.09918/) (2017)
- [Thread With Caution: Proactively Helping Users Assess and Deescalate Tension in Their Online Discussions](https://mlsanity.com/paper/2212.01401/) (2022)
- [Language and Mental Health: Measures of Emotion Dynamics from Text as Linguistic Biosocial Markers](https://mlsanity.com/paper/2310.17369/) (2023)
- [Designing for emotion regulation interventions: an agenda for HCI theory and research](https://mlsanity.com/paper/2204.00118/) (2022)
- [RECAST: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization](https://mlsanity.com/paper/2102.04427/) (2021)
- [Tweet Moodifier: Towards giving emotional awareness to Twitter users](https://mlsanity.com/paper/1907.11741/) (2019)

## Abstract (arXiv)

Social media platforms increasingly employ proactive moderation techniques, such as detecting and curbing toxic and uncivil comments, to prevent the spread of harmful content. Despite these efforts, such approaches are often criticized for creating a climate of censorship and failing to address the underlying causes of uncivil behavior. Our work makes both theoretical and practical contributions by proposing and evaluating two types of emotion monitoring dashboards to users' emotional awareness and mitigate hate speech. In a study involving 211 participants, we evaluate the effects of the two mechanisms on user commenting behavior and emotional experiences. The results reveal that these interventions effectively increase users' awareness of their emotional states and reduce hate speech. However, our findings also indicate potential unintended effects, including increased expression of negative emotions (Angry, Fear, and Sad) when discussing sensitive issues. These insights provide a basis for further research on integrating proactive emotion regulation tools into social media platforms to foster healthier digital interactions.
