mlsanityData to 7 Oct 2026

Detecting Community Sensitive Norm Violations in Online Conversations

arXiv 2110.04419 ↗First posted 9 Oct 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

Online platforms and communities establish their own norms that govern what behavior is acceptable within the community. Substantial effort in NLP has focused on identifying unacceptable behaviors and, recently, on forecasting them before they occur. However, these efforts have largely focused on toxicity as the sole form of community norm violation. Such focus has overlooked the much larger set of rules that moderators enforce. Here, we introduce a new dataset focusing on a more complete spectrum of community norms and their violations in the local conversational and global community contexts. We introduce a series of models that use this data to develop context- and community-sensitive norm violation detection, showing that these changes give high performance.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 9 Oct 2021.

Builds on

14 of 31 references.

References · 14

  1. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
  2. 2020The Pushshift Reddit Datasetcited by 289
  3. 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
  4. 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 173
  5. 2019Queens are Powerful too: Mitigating Gender Bias in Dialogue Generationcited by 152
  6. 2020Toxicity Detection: Does Context Really Matter?cited by 93
  7. 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
  8. 2018Conversations Gone Awry: Detecting Early Signs of Conversational Failurecited by 73
  9. 2019A Just and Comprehensive Strategy for Using NLP to Address Online Abusecited by 49
  10. 2019Trouble on the Horizon: Forecasting the Derailment of Online Conversations as they Developcited by 41
  11. 2017Like trainer, like bot? Inheritance of bias in algorithmic content moderationcited by 34
  12. 2020Unsupervised Discovery of Implicit Gender Biascited by 34
2 more
  1. 2019Something's Brewing! Early Prediction of Controversy-causing Posts from Discussion Featurescited by 21
  2. 2016Surviving an "Eternal September" - How an Online Community Managed a Surge of Newcomerscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 5; 2024: 5; 2025: 4; 2026: 3.

18 papers.

Sort:

By area:

  1. 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
  2. 2025MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governancecited by 13
  3. 2023Can Language Model Moderators Improve the Health of Online Discourse?cited by 12
  4. 2024ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactionscited by 12
  5. 2023CPL-NoViD: Context-Aware Prompt-based Learning for Norm Violation Detection in Online Communitiescited by 7
  6. 2023Your spouse needs professional help: Determining the Contextual Appropriateness of Messages through Modeling Social Relationshipscited by 6
  7. 2024Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Languagecited by 6
  8. 2024Argument Quality Assessment in the Age of Instruction-Following Large Language Modelscited by 4
  9. 2022Anger Breeds Controversy: Analyzing Controversy and Emotions on Redditcited by 3
  10. 2023Analyzing Norm Violations in Live-Stream Chatcited by 3
  11. 2024Promoting Constructive Deliberation: Reframing for Receptivenesscited by 3
  12. 2024WHoW: A Cross-domain Approach for Analysing Conversation Moderationcited by 3
6 more
  1. 2026The Gray Area: Characterizing Moderator Disagreement on Redditcited by 3
  2. 2025Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit Communitiescited by 1
  3. 2025Asking For It: Question-Answering for Predicting Rule Infractions in Online Content Moderationcited by 0
  4. 2025SPOT: An Annotated French Corpus and Benchmark for Detecting Critical Interventions in Online Conversationscited by 0
  5. 2026GASTON: Graph-Aware Social Transformer for Online Networkscited by 0
  6. 2026PluRule: A Benchmark for Moderating Pluralistic Communities on Social Mediacited by 0