mlsanityData to 7 Oct 2026

A Unified Taxonomy-Guided Instruction Tuning Framework for Entity Set Expansion and Taxonomy Expansion

arXiv 2402.13405 ↗First posted 20 Feb 2024cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

Entity set expansion, taxonomy expansion, and seed-guided taxonomy construction are three representative tasks that can be applied to automatically populate an existing taxonomy with emerging concepts. Previous studies view them as three separate tasks. Therefore, their proposed techniques usually work for one specific task only, lacking generalizability and a holistic perspective. In this paper, we aim at a unified solution to the three tasks. To be specific, we identify two common skills needed for entity set expansion, taxonomy expansion, and seed-guided taxonomy construction: finding "siblings" and finding "parents". We propose a taxonomy-guided instruction tuning framework to teach a large language model to generate siblings and parents for query entities, where the joint pre-training process facilitates the mutual enhancement of the two skills. Extensive experiments on multiple benchmark datasets demonstrate the efficacy of our proposed TaxoInstruct framework, which outperforms task-specific baselines across all three tasks.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 49 of its 83 references that are in the map. First posted on arXiv 20 Feb 2024.

Builds on

49 of 83 references.

References · 49

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  11. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  12. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
37 more
  1. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 249
  2. 2023Language is All a Graph Needscited by 219
  3. 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 209
  4. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  5. 2023Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPTcited by 78
  6. 2018Probabilistic Embedding of Knowledge Graphs with Box Lattice Measurescited by 64
  7. 2018A Web-scale system for scientific knowledge explorationcited by 39
  8. 2020Code and Named Entity Recognition in StackOverflowcited by 39
  9. 2020TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Networkcited by 37
  10. 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
  11. 2020COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generationcited by 32
  12. 2019HiExpan: Task-Guided Taxonomy Construction by Hierarchical Tree Expansioncited by 31
  13. 2020STEAM: Self-Supervised Taxonomy Expansion with Mini-Pathscited by 31
  14. 2016Improving Hypernymy Detection with an Integrated Path-based and Distributional Methodcited by 26
  15. 2022Contrastive Learning with Hard Negative Entities for Entity Set Expansioncited by 26
  16. 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
  17. 2019SetExpan: Corpus-Based Set Expansion via Context Feature Selection and Rank Ensemblecited by 25
  18. 2020Empower Entity Set Expansion via Language Model Probingcited by 25
  19. 2024Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examplescited by 24
  20. 2020Octet: Online Catalog Taxonomy Enrichment with Self-Supervisioncited by 22
  21. 2021Taxonomy Completion via Triplet Matching Networkcited by 21
  22. 2022Automatic Context Pattern Generation for Entity Set Expansioncited by 21
  23. 2022TaxoEnrich: Self-Supervised Taxonomy Completion via Structure-Semantic Representationscited by 20
  24. 2021Enhancing Taxonomy Completion with Concept Generation via Fusing Relational Representationscited by 19
  25. 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
  26. 2023The Effect of Metadata on Scientific Literature Tagging: A Cross-Field Cross-Model Studycited by 17
  27. 2020Guiding Corpus-based Set Expansion by Auxiliary Sets Generation and Co-Expansioncited by 13
  28. 2021Enquire One's Parent and Child Before Decision: Fully Exploit Hierarchical Structure for Self-Supervised Taxonomy Expansioncited by 13
  29. 2018Term Set Expansion based NLP Architect by Intel AI Labcited by 11
  30. 2020SynSetExpan: An Iterative Framework for Joint Entity Set Expansion and Synonym Discoverycited by 10
  31. 2021Knowledge-based Review Generation by Coherence Enhanced Text Planningcited by 10
  32. 2017Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learningcited by 9
  33. 2019Discovering Hypernymy in Text-Rich Heterogeneous Information Network by Exploiting Context Granularitycited by 8
  34. 2018Entity Set Search of Scientific Literature: An Unsupervised Ranking Approachcited by 7
  35. 2019Use of OWL and Semantic Web Technologies at Pinterestcited by 4
  36. 2022Entity Set Co-Expansion in StackOverflowcited by 2
  37. 2018Term Set Expansion based on Multi-Context Term Embeddings: an End-to-end Workflowcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.