mlsanityData to 7 Oct 2026

Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction

arXiv 2202.04876 ↗First posted 10 Feb 2022cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

In this paper, we analyze zero-shot taxonomy learning methods which are based on distilling knowledge from language models via prompting and sentence scoring. We show that, despite their simplicity, these methods outperform some supervised strategies and are competitive with the current state-of-the-art under adequate conditions. We also show that statistical and linguistic properties of prompts dictate downstream performance.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 10 Feb 2022.

Builds on

20 of 45 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Language Models as Knowledge Bases?cited by 1,922
  4. 2019How Can We Know What Language Models Know?cited by 953
  5. 2021Learning How to Ask: Querying LMs with Mixtures of Soft Promptscited by 376
  6. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 246
  7. 2019BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Modelcited by 184
  8. 2020Unsupervised Commonsense Question Answering with Self-Talkcited by 161
  9. 2021Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Modelscited by 132
  10. 2019Inducing Relational Knowledge from BERTcited by 75
  11. 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
  12. 2021Prompting Contrastive Explanations for Commonsense Reasoning Taskscited by 45
8 more
  1. 2020STEAM: Self-Supervised Taxonomy Expansion with Mini-Pathscited by 31
  2. 2020Self-supervised Knowledge Triplet Learning for Zero-shot Question Answeringcited by 29
  3. 2020Constructing Taxonomies from Pretrained Language Modelscited by 21
  4. 2018End-to-End Reinforcement Learning for Automatic Taxonomy Inductioncited by 17
  5. 2020Contextualized Representations Using Textual Encyclopedic Knowledgecited by 17
  6. 2021Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Modelscited by 13
  7. 2015INRIASAC: Simple Hypernym Extraction Methodscited by 3
  8. 2020Mining Knowledge for Natural Language Inference from Wikipedia Categoriescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 2.

8 papers.

  1. 2024Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examplescited by 24
  2. 2023Prompting or Fine-tuning? A Comparative Study of Large Language Models for Taxonomy Constructioncited by 18
  3. 2024TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Taskscited by 14
  4. 2025From Papers to Panoramas: Building Hierarchies of Scientific Literature at Scalecited by 7
  5. 2023Probing Pretrained Language Models with Hierarchy Propertiescited by 2
  6. 2024Exploring Prompt-Based Methods for Zero-Shot Hypernym Prediction with Large Language Modelscited by 1
  7. 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibrationcited by 0
  8. 2026SPARROW: Scalable Taxonomy Induction via Structure-Preserving Partitioning and Constraint-Guided Mergingcited by 0