mlsanityData to 14 Oct 2026

SCOPE and SCION: A Benchmark and an Auditable Reference Pipeline for Schema Induction and Fusion from Text

arXiv 2607.21610 ↗First posted 20 May 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Schema graphs are an upstream bottleneck of schema-grounded information extraction and knowledge graph construction, yet most extraction systems assume the schema is already available. We introduce SCOPE (Schema Construction and Ontology-induction Pipeline Evaluation), a train-text-only benchmark for corpus-to-schema induction and optional schema fusion from raw text, built from 24 public information extraction sources (15 RE and 9 EE) normalized into evaluation-only gold schema graphs; its core event-extraction target covers event types and within-event argument roles, with inter-event links reported separately. We present SCION (Schema Construction and Induction with Ontology Normalization), an auditable reference pipeline rather than a new extraction architecture; it constructs candidate spaces from train text and restricts naming, merging, filtering, validation, and conservative fusion to candidate-linked evidence under strict JSON contracts. On the SCOPE core suite, SCION-lite attains the highest F1 among released source-schema references, Text2Onto-style, LLM-only, and matched extract-then-aggregate baselines under Literal, Fuzzy, Continuous, and Graph schema-graph metrics, while the compact open-model SCION-RL variant reduces reliance on proprietary LLM schema engineers. These results are reported against normalized typed-edge targets rather than as claims that induced schemas surpass human ontology design; the release includes evidence-linked outputs, parse/fallback logs, candidate retention/merging logs, run manifests, code, and benchmark packages at https://github.com/wandugu/paper_scion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

16 of 36 references.

References · 16

  1. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  2. 2021Document-Level Event Argument Extraction by Conditional Generationcited by 155
  3. 2019Multi-Sentence Argument Linkingcited by 81
  4. 2022PHEE: A Dataset for Pharmacovigilance Event Extraction from Textcited by 37
  5. 2023Exploring Large Language Models for Ontology Alignmentcited by 26
  6. 2023Schema-Driven Information Extraction from Heterogeneous Tablescited by 25
  7. 2024SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documentscited by 21
  8. 2024End-to-End Ontology Learning with Large Language Modelscited by 13
  9. 2022CrudeOilNews: An Annotated Crude Oil News Corpus for Event Extractioncited by 10
  10. 2024Ontology-grounded Automatic Knowledge Graph Construction by LLM under Wikidata schemacited by 10
  11. 2023InstructIE: A Bilingual Instruction-based Information Extraction Datasetcited by 9
  12. 2019IPRE: a Dataset for Inter-Personal Relationship Extractioncited by 8
4 more
  1. 2020Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extractioncited by 8
  2. 2024LLMs4OL 2024 Overview: The 1st Large Language Models for Ontology Learning Challengecited by 8
  3. 2018Combining Distant and Direct Supervision for Neural Relation Extractioncited by 6
  4. 2025Ontology Matching with Large Language Models and Prioritized Depth-First Searchcited by 5

Built on by

Not cited yet.