Ontology Enrichment for Effective Fine-grained Entity Typing
Not on the map. Why?
Abstract (arXiv)
Fine-grained entity typing (FET) is the task of identifying specific entity types at a fine-grained level for entity mentions based on their contextual information. Conventional methods for FET require extensive human annotation, which is time-consuming and costly. Recent studies have been developing weakly supervised or zero-shot approaches. We study the setting of zero-shot FET where only an ontology is provided. However, most existing ontology structures lack rich supporting information and even contain ambiguous relations, making them ineffective in guiding FET. Recently developed language models, though promising in various few-shot and zero-shot NLP tasks, may face challenges in zero-shot FET due to their lack of interaction with task-specific ontology. In this study, we propose OnEFET, where we (1) enrich each node in the ontology structure with two types of extra information: instance information for training sample augmentation and topic information to relate types to contexts, and (2) develop a coarse-to-fine typing algorithm that exploits the enriched information by training an entailment model with contrasting topics and instance-based augmented training samples. Our experiments show that OnEFET achieves high-quality fine-grained entity typing without human annotation, outperforming existing zero-shot methods by a large margin and rivaling supervised methods.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 65 references that are in the map. First posted on arXiv 11 Oct 2023.
Builds on
36 of 65 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2018Ultra-Fine Entity Typingcited by 87
24 more
- 2021OntoZSL: Ontology-enhanced Zero-shot Learningcited by 45
- 2021Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Modelcited by 39
- 2014Context-Dependent Fine-Grained Entity Type Taggingcited by 30
- 2016Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embeddingcited by 22
- 2019Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typingcited by 22
- 2020Octet: Online Catalog Taxonomy Enrichment with Self-Supervisioncited by 22
- 2021Fine-grained Entity Typing via Label Reasoningcited by 22
- 2018Neural Fine-Grained Entity Type Classification with Hierarchy-Aware Losscited by 20
- 2019Zero-Shot Open Entity Typing as Type-Compatible Groundingcited by 19
- 2018Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linkingcited by 18
- 2020Improving Entity Linking by Modeling Latent Entity Type Informationcited by 18
- 2020Hierarchical Entity Typing via Multi-level Learning to Rankcited by 18
- 2022Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inferencecited by 17
- 2016Neural Architectures for Fine-grained Entity Type Classificationcited by 15
- 2020MZET: Memory Augmented Zero-Shot Fine-grained Named Entity Typingcited by 12
- 2022Open-Vocabulary Argument Role Prediction for Event Extractioncited by 11
- 2019Improving Fine-grained Entity Typing with Entity Linkingcited by 9
- 2022Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generationcited by 9
- 2018Entity Set Search of Scientific Literature: An Unsupervised Ranking Approachcited by 7
- 2022Seed-Guided Topic Discovery with Out-of-Vocabulary Seedscited by 7
- 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
- 2017Fine-Grained Entity Typing with High-Multiplicity Assignmentscited by 3
- 2023Topic Ontologies for Argumentscited by 3
- 2022Entity Set Co-Expansion in StackOverflowcited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.