mlsanityData to 14 Oct 2026

Initial Evaluation of Potential Bias in Coverage of Humans in Wikidata

arXiv 2609.22375 ↗First posted 17 Sep 2026cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Introduction. Open collaborative knowledge graphs such as Wikidata increasingly ground agentic artificial intelligence, information retrieval, and language modeling systems, making systematic auditing of their demographic representation and overall equity a research imperative. Methods. Herein, we present an open-source auditing platform that ingests over 10 million statement bindings representing over 6 million humans on Wikidata via QLever, and evaluates representation of gender, sexual orientation, geography, birthplace urbanicity, ethnicity, multilingual coverage of labels, descriptions, and aliases, occupation, and select intersectional pairs of these entities. It does so by making use of Chi-square goodness-of-fit tests, 95% Wilson-score confidence intervals, and disparity ratios, in light of Rubin's missingness taxonomy. Results. Women accounted for 28.71% (CI +/-0.04) of all humans in Wikidata with a stated gender. 38.26% of humans had a citizenship statement, with Western Europe and North America (WENA) representing approximately 53% of such statements. Among 1.8 million birthplaces that could be classified, rural birthplaces were observed in 2.48% of cases (in comparison to 27.4% global baseline). Fewer than 1.2% of entities carried an ethnicity statement, and non-English Wikidata descriptions covered 18.2% of items. Discussion. Our findings reveal significant missingness across the evaluated axes. Ethnicity and sexual orientation were the most critically under-documented (missing statements) while rural birthplaces and non-WENA citizenship were the most underrepresented.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 26 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

2 of 26 references.

References · 2

  1. 2021Analyzing Race and Country of Citizenship Bias in Wikidatacited by 6
  2. 2022Mitigating Relational Bias on Knowledge Graphscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lens
  2. 2025Investigating Intersectional Bias in Large Language Models using Confidence Disparities in Coreference Resolution
  3. 2024Protected group bias and stereotypes in Large Language Models
  4. 2023SocialStigmaQA: A Benchmark to Uncover Stigma Amplification in Generative Language Models
  5. 2026ImplicitBBQ: Benchmarking Implicit Bias in Large Language Models through Characteristic Based Cues
  6. 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models
  7. 2024Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness
  8. 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing