mlsanityData to 14 Oct 2026

A Hybrid DeBERTa and Gated Broad Learning System for Cyberbullying Detection in English Text

arXiv 2506.16052 ↗First posted 19 Jun 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of online communication platforms has created unprecedented opportunities for global connectivity while simultaneously enabling harmful behaviors such as cyberbullying, which affects approximately 54.4% of teenagers according to recent research. This paper presents a hybrid architecture that combines the contextual understanding capabilities of transformer-based models with the pattern recognition strengths of broad learning systems for effective cyberbullying detection. This approach integrates a modified DeBERTa model augmented with Squeeze-and-Excitation blocks and sentiment analysis capabilities with a Gated Broad Learning System (GBLS) classifier, creating a synergistic framework that outperforms existing approaches across multiple benchmark datasets. The proposed ModifiedDeBERTa + GBLS model achieved good performance on four English datasets: 79.3% accuracy on HateXplain, 95.41% accuracy on SOSNet, 91.37% accuracy on Mendeley-I, and 94.67% accuracy on Mendeley-II. Beyond performance gains, the framework incorporates comprehensive explainability mechanisms including token-level attribution analysis, LIME-based local interpretations, and confidence calibration, addressing critical transparency requirements in automated content moderation. Ablation studies confirm the meaningful contribution of each architectural component, while failure case analysis reveals specific challenges in detecting implicit bias and sarcastic content, providing valuable insights for future improvements in cyberbullying detection systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

16 of 27 references.

References · 16

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  2. 2017On Calibration of Modern Neural Networkscited by 4,960
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  8. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  9. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  10. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  11. 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
  12. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
4 more
  1. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
  2. 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
  3. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  4. 2018Automatic Detection of Cyberbullying in Social Media Textcited by 26

Built on by

Not cited yet.