mOKB6: A Multilingual Open Knowledge Base Completion Benchmark
Not on the map. Why?
Abstract (arXiv)
Automated completion of open knowledge bases (Open KBs), which are constructed from triples of the form (subject phrase, relation phrase, object phrase), obtained via open information extraction (Open IE) system, are useful for discovering novel facts that may not be directly present in the text. However, research in Open KB completion (Open KBC) has so far been limited to resource-rich languages like English. Using the latest advances in multilingual Open IE, we construct the first multilingual Open KBC dataset, called mOKB6, containing facts from Wikipedia in six languages (including English). Improving the previous Open KB construction pipeline by doing multilingual coreference resolution and keeping only entity-linked triples, we create a dense Open KB. We experiment with several models for the task and observe a consistent benefit of combining languages with the help of shared embedding space as well as translations of facts. We also observe that current multilingual models struggle to remember facts seen in languages of different scripts.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 13 Nov 2022.
Builds on
25 of 44 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
- 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 127
13 more
- 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 120
- 2021Decontextualization: Making Sentences Stand-Alonecited by 102
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
- 2021Multilingual Autoregressive Entity Linkingcited by 50
- 2021Word-Level Coreference Resolutioncited by 40
- 2019CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Informationcited by 28
- 2020Multi2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERTcited by 26
- 2020Multilingual Knowledge Graph Completion via Ensemble Knowledge Transfercited by 25
- 2019OPIEC: An Open Information Extraction Corpuscited by 20
- 2021Moving on from OntoNotes: Coreference Resolution Model Transfercited by 18
- 2022Findings of the Shared Task on Multilingual Coreference Resolutioncited by 13
- 2021OKGIT: Open Knowledge Graph Link Prediction with Implicit Typescited by 6
- 2021Knowledge Base Completion Meets Transfer Learningcited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 2; 2026: 2.
7 papers.
- 2025ECLeKTic: a Novel Challenge Set for Evaluation of Cross-Lingual Knowledge Transfercited by 29
- 2023ZGUL: Zero-shot Generalization to Unseen Languages using Multi-source Ensembling of Language Adapterscited by 10
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Mediacited by 8
- 2024Evaluating Knowledge-based Cross-lingual Inconsistency in Large Language Modelscited by 4
- 2025OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literaturecited by 4
- 2026Skill Issue: Are Skills Language-Invariant in LLMs?cited by 1
- 2026Target-Language Generation in Multilingual Models: Activation Steering and Optimal Controlcited by 0
- 2026Target-Language Generation in Multilingual Models: Activation Steering and Optimal Control15 Sep 2026
- 2026Skill Issue: Are Skills Language-Invariant in LLMs?26 Aug 2026
- 2025OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature28 May 2025
- 2025ECLeKTic: a Novel Challenge Set for Evaluation of Cross-Lingual Knowledge Transfer28 Feb 2025
- 2024Evaluating Knowledge-based Cross-lingual Inconsistency in Large Language Models1 Jul 2024
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Media27 Oct 2023
- 2023ZGUL: Zero-shot Generalization to Unseen Languages using Multi-source Ensembling of Language Adapters25 Oct 2023