mlsanityData to 14 Oct 2026

Taxonomy Tree Generation from Citation Graph

arXiv 2410.03761 ↗First posted 2 Oct 2024cs.CL cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Constructing taxonomies from citation graphs is essential for organizing scientific knowledge, facilitating literature reviews, and identifying emerging research trends. However, manual taxonomy construction is labor-intensive, time-consuming, and prone to human biases, often overlooking pivotal but less-cited papers. In this paper, to enable automatic hierarchical taxonomy generation from citation graphs, we propose HiGTL (Hierarchical Graph Taxonomy Learning), a novel end-to-end framework guided by human-provided instructions or preferred topics. Specifically, we propose a hierarchical citation graph clustering method that recursively groups related papers based on both textual content and citation structure, ensuring semantically meaningful and structurally coherent clusters. Additionally, we develop a novel taxonomy node verbalization strategy that iteratively generates central concepts for each cluster, leveraging a pre-trained large language model (LLM) to maintain semantic consistency across hierarchical levels. To further enhance performance, we design a joint optimization framework that fine-tunes both the clustering and concept generation modules, aligning structural accuracy with the quality of generated taxonomies. Extensive experiments demonstrate that HiGTL effectively produces coherent, high-quality taxonomies.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 18 of its 53 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

18 of 53 references.

References · 18

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2017Graph Attention Networkscited by 8,923
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  9. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  10. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  11. 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 118
  12. 2020Continual Learning in Task-Oriented Dialogue Systemscited by 83
6 more
  1. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  2. 2018TaxoGen: Unsupervised Topic Taxonomy Construction by Adaptive Term Embedding and Clusteringcited by 49
  3. 2018A Web-scale system for scientific knowledge explorationcited by 39
  4. 2019HiExpan: Task-Guided Taxonomy Construction by Hierarchical Tree Expansioncited by 31
  5. 2022Matrix Completion with Hierarchical Graph Side Informationcited by 5
  6. 2024End-to-End Supervised Hierarchical Graph Clustering for Speaker Diarizationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.