mlsanityData to 14 Oct 2026

Curate Before You Connect: Identity and Ontology Tagging in a Production Knowledge Graph

arXiv 2608.10644 ↗First posted 11 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Extraction produces candidate entities and relationships; writing them into a graph is where identity is decided, and identity decisions are destructive in a way extraction errors are not. A wrong type can be corrected later, but two records merged under one identity cannot be separated once their properties have been combined, and the merge leaves no error behind. This paper describes the ingestion and ontology-tagging layer that turns a validated extraction stream into a knowledge graph of 537,157 entities and 2,198,567 relationships drawn from 98,795 government documents. We describe a record-identity ladder that decides sameness from identifier columns, name columns, display names and type-scoped position rather than from name similarity. The ladder governs de-duplication within parsed tables, while the graph write applies a coarser canonical-name key, so records sharing a canonical name merge automatically on exact equality. We argue rather than demonstrate that this is where the automation line belongs: no identity benchmark is reported, and the over-merges the key permits are undetectable by construction. That policy, under which entity resolution only ever flags candidates, followed an incident in which two surface forms of one name were merged, corrupting a correct record and deleting eight entities from an unrelated document. We then describe multi-class ontology tagging and an evidence asymmetry we did not anticipate: an entity name is an instance label rather than a type assertion, so matching name fragments against a class index invents classifications. Requiring anchored evidence cut role assignments on an enriched sample from 36 to 4, all confirmed correct. We quantify the graph's conformance debt, show secondary classifications compensating for a mis-parented primary class, and describe a curation queue grown to 48,403 pending proposals against 775 human decisions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 60 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

12 of 60 references.

References · 12

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  5. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  6. 2020Knowledge Graphscited by 621
  7. 2023Efficient Guided Generation for Large Language Modelscited by 200
  8. 2020Deep Entity Matching with Pre-Trained Language Modelscited by 144
  9. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  10. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
  11. 2019CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Informationcited by 28
  12. 2024The Common Core Ontologiescited by 8

Built on by

Not cited yet.