cs.CYSep 17, 2026

Initial Evaluation of Potential Bias in Coverage of Humans in Wikidata

Authors: Clair Kronk

Organizations: Institute for Health Equity Research (IHER), Department of Population Health Science & Policy (PHSP), Icahn School of Medicine at Mount Sinai (ISMMS), New York, NY, USA · Department of Artificial Intelligence and Human Health (AIHH), Icahn School of Medicine at Mount Sinai (ISMMS), New York, NY, USA

Abstract

Introduction. Open collaborative knowledge graphs such as Wikidata increasingly ground agentic artificial intelligence, information retrieval, and language modeling systems, making systematic auditing of their demographic representation and overall equity a research imperative. Methods. Herein, we present an open-source auditing platform that ingests over 10 million statement bindings representing over 6 million humans on Wikidata via QLever, and evaluates representation of gender, sexual orientation, geography, birthplace urbanicity, ethnicity, multilingual coverage of labels, descriptions, and aliases, occupation, and select intersectional pairs of these entities. It does so by making use of Chi-square goodness-of-fit tests, 95% Wilson-score confidence intervals, and disparity ratios, in light of Rubin's missingness taxonomy. Results. Women accounted for 28.71% (CI +/-0.04) of all humans in Wikidata with a stated gender. 38.26% of humans had a citizenship statement, with Western Europe and North America (WENA) representing approximately 53% of such statements. Among 1.8 million birthplaces that could be classified, rural birthplaces were observed in 2.48% of cases (in comparison to 27.4% global baseline). Fewer than 1.2% of entities carried an ethnicity statement, and non-English Wikidata descriptions covered 18.2% of items. Discussion. Our findings reveal significant missingness across the evaluated axes. Ethnicity and sexual orientation were the most critically under-documented (missing statements) while rural birthplaces and non-WENA citizenship were the most underrepresented.

Explore similar work

CardsList
  1. SQuIREL: A Context-Relative Framework for Measuring Entity Richness in Wikidata

    Oct 17, 2026Michelle Nwachukwu, Albert Meroño-Peñuela, Martim BrandãoKnowledge Graphs

  2. Leveraging Wikidata for Geographically Informed Sociocultural Bias Dataset Creation: Application to Latin America

    Feb 16, 2026Yannis Karmim, Renato Pino, Hernan Contreras +6Cultural Bias in Language ModelsCultural Knowledge in Language Models