mlsanityData to 14 Oct 2026

A Framework for Leveraging Human Computation Gaming to Enhance Knowledge Graphs for Accuracy Critical Generative AI Applications

arXiv 2404.19729 ↗First posted 30 Apr 2024cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

External knowledge graphs (KGs) can be used to augment large language models (LLMs), while simultaneously providing an explainable knowledge base of facts that can be inspected by a human. This approach may be particularly valuable in domains where explainability is critical, like human trafficking data analysis. However, creating KGs can pose challenges. KGs parsed from documents may comprise explicit connections (those directly stated by a document) but miss implicit connections (those obvious to a human although not directly stated). To address these challenges, this preliminary research introduces the GAME-KG framework, standing for "Gaming for Augmenting Metadata and Enhancing Knowledge Graphs." GAME-KG is a federated approach to modifying explicit as well as implicit connections in KGs by using crowdsourced feedback collected through video games. GAME-KG is shown through two demonstrations: a Unity test scenario from Dark Shadows, a video game that collects feedback on KGs parsed from US Department of Justice (DOJ) Press Releases on human trafficking, and a following experiment where OpenAI's GPT-4 is prompted to answer questions based on a modified and unmodified KG. Initial results suggest that GAME-KG can be an effective framework for enhancing KGs, while simultaneously providing an explainable set of structured facts verified by humans.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 22 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

7 of 22 references.

References · 7

  1. 2023Explainability for Large Language Models: A Surveycited by 333
  2. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  3. 2019Barack's Wife Hillary: Using Knowledge-Graphs for Fact-Aware Language Modelingcited by 71
  4. 2023Knowledge Graphs: Opportunities and Challengescited by 70
  5. 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
  6. 2021A Systematic Investigation of Commonsense Knowledge in Large Language Modelscited by 56
  7. 2019Implicit Knowledge in Argumentative Texts: An Annotated Corpuscited by 6

Built on by

Not cited yet.