mlsanityData to 7 Oct 2026

Community Norms in the Spotlight: Enabling Task-Agnostic Unsupervised Pre-Training to Benefit Online Social Media

arXiv 2602.02525 ↗First posted 26 Jan 2026cs.SI cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modelling the complex dynamics of online social platforms is critical for addressing challenges such as hate speech and misinformation. While Discussion Transformers, which model conversations as graph structures, have emerged as a promising architecture, their potential is severely constrained by reliance on high-quality, human-labelled datasets. In this paper, we advocate a paradigm shift from task-specific fine-tuning to unsupervised pretraining, grounded in an entirely novel consideration of community norms. We posit that this framework not only mitigates data scarcity but also enables interpretation of the social norms underlying the decisions made by such an AI system. Ultimately, we believe that this direction offers many opportunities for AI for Social Good.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

17 of 47 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2017Graph Attention Networkscited by 8,854
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  8. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  9. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
  10. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  11. 2020Quantifying social organization and political polarization in online platformscited by 30
  12. 2020Towards a Framework for Certification of Reliable Autonomous Systemscited by 12
5 more
  1. 2024Towards Foundation-model-based Multiagent System to Accelerate AI for Social Impactcited by 9
  2. 2023Predicting Hateful Discussions on Reddit using Graph Transformer Networks and Communal Contextcited by 8
  3. 2023Multi-Modal Discussion Transformer: Integrating Text, Images and Graph Transformers to Detect Hate Speech on Social Mediacited by 6
  4. 2024Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitationscited by 2
  5. 2025NormGenesis: Multicultural Dialogue Generation via Exemplar-Guided Social Norm Modeling and Violation Recoverycited by 2

Built on by

Not cited yet.