mlsanityData to 7 Oct 2026

StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes

arXiv 2205.14036 ↗First posted 27 May 2022cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

Analyzing ethnic or religious bias is important for improving fairness, accountability, and transparency of natural language processing models. However, many techniques rely on human-compiled lists of bias terms, which are expensive to create and are limited in coverage. In this study, we present a fully data-driven pipeline for generating a knowledge graph (KG) of cultural knowledge and stereotypes. Our resulting KG covers 5 religious groups and 5 nationalities and can easily be extended to include more entities. Our human evaluation shows that the majority (59.2%) of non-singleton entries are coherent and complete stereotypes. We further show that performing intermediate masked language model training on the verbalized KG leads to a higher level of cultural awareness in the model and has the potential to increase classification performance on knowledge-crucial samples on a related task, i.e., hate speech detection.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 27 May 2022.

Builds on

25 of 45 references.

References · 25

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  5. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  6. 2018Neural Network Acceptability Judgmentscited by 952
  7. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  8. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  9. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  10. 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
  11. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
  12. 2019Knowledge Enhanced Contextual Word Representationscited by 294
13 more
  1. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  2. 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
  3. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
  4. 2020Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT modelcited by 87
  5. 2020Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformerscited by 57
  6. 2020GenericsKB: A Knowledge Base of Generic Statementscited by 51
  7. 2020Stereotypical Bias Removal for Hate Speech Detection Task using Knowledge-based Generalizationscited by 40
  8. 2021Analyzing Commonsense Emergence in Few-shot Knowledge Modelscited by 34
  9. 2020Towards an Atlas of Cultural Commonsense for Machine Reasoningcited by 28
  10. 2017Verb Physics: Relative Physical Knowledge of Actions and Objectscited by 26
  11. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  12. 2021Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?cited by 16
  13. 2021K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretrainingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 5; 2025: 4; 2026: 2.

14 papers.

Sort:

By area:

  1. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
  2. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
  3. 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
  4. 2023Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreementcited by 22
  5. 2024Cultural Commonsense Knowledge for Intercultural Dialoguescited by 20
  6. 2023GD-COMET: A Geo-Diverse Commonsense Inference Modelcited by 13
  7. 2025Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkishcited by 12
  8. 2024Tox-BART: Leveraging Toxicity Attributes for Explanation Generation of Implicit Hate Speechcited by 11
  9. 2024SafeWorld: Geo-Diverse Safety Alignmentcited by 10
  10. 2025SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabiacited by 8
  11. 2025Toward Revealing Nuanced Biases in Medical LLMscited by 1
  12. 2025Tahakom LLM Guidelines and Recipes: From Pre-training Data to an Arabic LLMcited by 0
2 more
  1. 2026Conceptual Cultural Index: A Metric for Cultural Specificity via Relative Generalitycited by 0
  2. 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0