Situated Ground Truths: Enhancing Bias-Aware AI by Situating Data Labels with SituAnnotate
Not on the map. Why?
Abstract (arXiv)
In the contemporary world of AI and data-driven applications, supervised machines often derive their understanding, which they mimic and reproduce, through annotations--typically conveyed in the form of words or labels. However, such annotations are often divorced from or lack contextual information, and as such hold the potential to inadvertently introduce biases when subsequently used for training. This paper introduces SituAnnotate, a novel ontology explicitly crafted for 'situated grounding,' aiming to anchor the ground truth data employed in training AI systems within the contextual and culturally-bound situations from which those ground truths emerge. SituAnnotate offers an ontology-based approach to structured and context-aware data annotation, addressing potential bias issues associated with isolated annotations. Its representational power encompasses situational context, including annotator details, timing, location, remuneration schemes, annotation roles, and more, ensuring semantic richness. Aligned with the foundational Dolce Ultralight ontology, it provides a robust and consistent framework for knowledge representation. As a method to create, query, and compare label-based datasets, SituAnnotate empowers downstream AI systems to undergo training with explicit consideration of context and cultural bias, laying the groundwork for enhanced system interpretability and adaptability, and enabling AI models to align with a multitude of cultural contexts and viewpoints.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 84 references that are in the map. First posted on arXiv 10 Jun 2024.
Builds on
21 of 84 references.
References · 21
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2018A comparative study of fairness-enhancing interventions in machine learningcited by 208
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
- 2019Does Object Recognition Work for Everyone?cited by 149
- 2021Toward a Perspectivist Turn in Ground Truthing for Predictive Computingcited by 129
- 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2019Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?cited by 64
- 2020Measuring Social Biases in Grounded Vision and Language Embeddingscited by 61
9 more
- 2021A Step Toward More Inclusive People Annotations for Fairnesscited by 46
- 2021"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data?cited by 24
- 2021A survey of image labelling for computer vision applicationscited by 18
- 2022D-BIAS: A Causality-Based Human-in-the-Loop System for Tackling Algorithmic Biascited by 18
- 2019Towards Traceability in Data Ecosystems using a Bill of Materials Modelcited by 12
- 2023DOLCE: A Descriptive Ontology for Linguistic and Cognitive Engineeringcited by 11
- 2021Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Framescited by 4
- 2017Learning Semantics for Image Annotationcited by 1
- 2024Stitching Gaps: Fusing Situated Perceptual Knowledge with Vision Transformers for High-Level Image Classificationcited by 1
Built on by
Not cited yet.