mlsanityData to 7 Oct 2026

Knowledge Graph-Enhanced Zero-Shot Topic Classification: A Multi-Strategy Comparative Study

arXiv 2605.30465 ↗First posted 28 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-label topic classification without labeled training data is a challenging task, specially when documents contain complex relational information. We present a zero-shot multi-label topic classification framework and systematically investigate how per-article knowledge graph augmentation affects its performance. The base framework classifies topics in documents without labeled training data and has four variants: article-only classification, keyword-enhanced classification, and self-consistency decoding variants of both. Then, we augment each base variant with per article knowledge graph. This graph is extracted from the input document through a pipeline similar to KGGen based on subject-predicate-object triples. We test all eight methods, four base and four graph augmented on fifteen LLMs and eight multi-label datasets across different domains. For the base framework, keyword-enhanced classification (AK) is the best performing method, and six out of fifteen LLMs surpass the sentence-encoder baseline. Graph augmentation has positive and negative impacts on small and large models, respectively. This shows that larger models already contain enough relational information from pretraining. Furthermore, the self-consistency decoding variant does not show performance improvements in any experiment while increasing computation costs about fivefold.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 77 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

36 of 77 references.

References · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2024Mixtral of Expertscited by 1,785
  10. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  11. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  12. 2020Knowledge Graphscited by 619
24 more
  1. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  2. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  3. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  4. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  5. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  6. 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 111
  7. 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoningcited by 105
  8. 2018Weakly-Supervised Neural Text Classificationcited by 66
  9. 2022Can Large Language Models Truly Understand Prompts? A Case Study with Negated Promptscited by 56
  10. 2019Zero-shot Text Classification With Generative Language Modelscited by 55
  11. 2018Zero-shot User Intent Detection via Capsule Neural Networkscited by 54
  12. 2025KGGen: Extracting Knowledge Graphs from Plain Text with Language Modelscited by 49
  13. 2019Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classificationcited by 31
  14. 2023Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?cited by 31
  15. 2023Better patching using LLM prompting, via Self-Consistencycited by 29
  16. 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
  17. 2017Train Once, Test Anywhere: Zero-Shot Learning for Text Classificationcited by 22
  18. 2023Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarioscited by 18
  19. 2017Multi-label Dataless Text Classification with Topic Modelingcited by 14
  20. 2019Towards Automated Sexual Violence Report Trackingcited by 7
  21. 2016Generalized Topic Modelingcited by 3
  22. 2025KG-HTC: Integrating Knowledge Graphs into LLMs for Effective Zero-shot Hierarchical Text Classificationcited by 3
  23. 2025From Haystack to Needle: Label Space Reduction for Zero-shot Classificationcited by 2
  24. 2024FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domaincited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective
  2. 2024Retrieval-Augmented Language Model for Extreme Multi-Label Knowledge Graph Link Prediction
  3. 2025A Zero-shot Learning Method Based on Large Language Models for Multi-modal Knowledge Graph Embedding
  4. 2024TopicTag: Automatic Annotation of NMF Topic Models Using Chain of Thought and Prompt Tuning with LLMs
  5. 2026HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification
  6. 2024Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification
  7. 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillation
  8. 2024Distilling Large Language Models for Text-Attributed Graph Learning