mlsanityData to 7 Oct 2026

Ontology Enrichment for Effective Fine-grained Entity Typing

arXiv 2310.07795 ↗First posted 11 Oct 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Fine-grained entity typing (FET) is the task of identifying specific entity types at a fine-grained level for entity mentions based on their contextual information. Conventional methods for FET require extensive human annotation, which is time-consuming and costly. Recent studies have been developing weakly supervised or zero-shot approaches. We study the setting of zero-shot FET where only an ontology is provided. However, most existing ontology structures lack rich supporting information and even contain ambiguous relations, making them ineffective in guiding FET. Recently developed language models, though promising in various few-shot and zero-shot NLP tasks, may face challenges in zero-shot FET due to their lack of interaction with task-specific ontology. In this study, we propose OnEFET, where we (1) enrich each node in the ontology structure with two types of extra information: instance information for training sample augmentation and topic information to relate types to contexts, and (2) develop a coarse-to-fine typing algorithm that exploits the enriched information by training an entailment model with contrasting topics and instance-based augmented training samples. Our experiments show that OnEFET achieves high-quality fine-grained entity typing without human annotation, outperforming existing zero-shot methods by a large margin and rivaling supervised methods.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 65 references that are in the map. First posted on arXiv 11 Oct 2023.

Builds on

36 of 65 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Language Models as Knowledge Bases?cited by 1,922
  6. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  7. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  8. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  9. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  10. 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
  11. 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
  12. 2018Ultra-Fine Entity Typingcited by 87
24 more
  1. 2021OntoZSL: Ontology-enhanced Zero-shot Learningcited by 45
  2. 2021Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Modelcited by 39
  3. 2014Context-Dependent Fine-Grained Entity Type Taggingcited by 30
  4. 2016Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embeddingcited by 22
  5. 2019Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typingcited by 22
  6. 2020Octet: Online Catalog Taxonomy Enrichment with Self-Supervisioncited by 22
  7. 2021Fine-grained Entity Typing via Label Reasoningcited by 22
  8. 2018Neural Fine-Grained Entity Type Classification with Hierarchy-Aware Losscited by 20
  9. 2019Zero-Shot Open Entity Typing as Type-Compatible Groundingcited by 19
  10. 2018Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linkingcited by 18
  11. 2020Improving Entity Linking by Modeling Latent Entity Type Informationcited by 18
  12. 2020Hierarchical Entity Typing via Multi-level Learning to Rankcited by 18
  13. 2022Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inferencecited by 17
  14. 2016Neural Architectures for Fine-grained Entity Type Classificationcited by 15
  15. 2020MZET: Memory Augmented Zero-Shot Fine-grained Named Entity Typingcited by 12
  16. 2022Open-Vocabulary Argument Role Prediction for Event Extractioncited by 11
  17. 2019Improving Fine-grained Entity Typing with Entity Linkingcited by 9
  18. 2022Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generationcited by 9
  19. 2018Entity Set Search of Scientific Literature: An Unsupervised Ranking Approachcited by 7
  20. 2022Seed-Guided Topic Discovery with Out-of-Vocabulary Seedscited by 7
  21. 2023ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervisioncited by 7
  22. 2017Fine-Grained Entity Typing with High-Multiplicity Assignmentscited by 3
  23. 2023Topic Ontologies for Argumentscited by 3
  24. 2022Entity Set Co-Expansion in StackOverflowcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.