mlsanityData to 7 Oct 2026

WiRe57 : A Fine-Grained Benchmark for Open Information Extraction

arXiv 1809.08962 ↗First posted 24 Sep 2018cs.CL cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

We build a reference for the task of Open Information Extraction, on five documents. We tentatively resolve a number of issues that arise, including inference and granularity. We seek to better pinpoint the requirements for the task. We produce our annotation guidelines specifying what is correct to extract and what is not. In turn, we use this reference to score existing Open IE systems. We address the non-trivial problem of evaluating the extractions produced by systems against the reference tuples, and share our evaluation script. Among seven compared extractors, we find the MinIE system to perform best.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 5; 2023: 1; 2024: 2; 2025: 2; 2026: 1.

16 papers.

Sort:

By area:

  1. 2022A Survey on Neural Open Information Extraction: Current Status and Future Directionscited by 27
  2. 2021LSOIE: A Large-Scale Dataset for Supervised Open Information Extractioncited by 15
  3. 2021BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluationcited by 11
  4. 2022DetIE: Multilingual Open Information Extraction Inspired by Object Detectioncited by 11
  5. 2021DocOIE: A Document-level Context-Aware Dataset for OpenIEcited by 10
  6. 2022A Survey on Open Information Extraction from Rule-based Model to Large Language Modelcited by 8
  7. 2023Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extractioncited by 8
  8. 2021AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction Benchmarkcited by 7
  9. 2022CompactIE: Compact Facts in Open Information Extractioncited by 5
  10. 2022When to Use What: An In-Depth Comparative Empirical Analysis of OpenIE Systems for Downstream Applicationscited by 4
  11. 2021Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literaturecited by 0
  12. 2024Rules still work for Open Information Extractioncited by 0
4 more
  1. 2024textitBenchIEFL : A Manually Re-Annotated Fact-Based Open Information Extraction Benchmarkcited by 0
  2. 2025Challenges in Expanding Portuguese Resources: A View from Open Information Extractioncited by 0
  3. 2025A linguistically-motivated evaluation methodology for unraveling model's abilities in reading comprehension taskscited by 0
  4. 2026DiffIE: Diffusion-based Open Information Extractioncited by 0