mlsanityData to 14 Oct 2026

HBert + BiasCorp -- Fighting Racism on the Web

arXiv 2104.02242 ↗First posted 6 Apr 2021cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Subtle and overt racism is still present both in physical and online communities today and has impacted many lives in different segments of the society. In this short piece of work, we present how we're tackling this societal issue with Natural Language Processing. We are releasing BiasCorp, a dataset containing 139,090 comments and news segment from three specific sources - Fox News, BreitbartNews and YouTube. The first batch (45,000 manually annotated) is ready for publication. We are currently in the final phase of manually labeling the remaining dataset using Amazon Mechanical Turk. BERT has been used widely in several downstream tasks. In this work, we present hBERT, where we modify certain layers of the pretrained BERT model with the new Hopfield Layer. hBert generalizes well across different distributions with the added advantage of a reduced model complexity. We are also releasing a JavaScript library and a Chrome Extension Application, to help developers make use of our trained model in web applications (say chat application) and for users to identify and report racially biased contents on the web respectively.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 6 Apr 2021.

Builds on

10 of 26 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Layer Normalizationcited by 5,669
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  6. 2020Hopfield Networks is All You Needcited by 475
  7. 2019Q8BERT: Quantized 8Bit BERTcited by 300
  8. 2020Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learningcited by 185
  9. 2017Learning From Noisy Large-Scale Datasets With Minimal Supervisioncited by 115
  10. 2020Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERTcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 1; 2023: 0; 2024: 0; 2025: 0; 2026: 1.

4 papers.

  1. 2021Revisiting Contextual Toxicity Detection in Conversationscited by 8
  2. 2021Adversarial Attacks and Defenses for Social Network Text Processing Applications: Techniques, Challenges and Future Research Directionscited by 4
  3. 2022UMass PCL at SemEval-2022 Task 4: Pre-trained Language Model Ensembles for Detecting Patronizing and Condescending Languagecited by 0
  4. 2026Sinkhorn Based Associative Memory Retrieval Using Spherical Hellinger Kantorovich Dynamicscited by 0