Knowledge Graph-Enhanced Zero-Shot Topic Classification: A Multi-Strategy Comparative Study
Not on the map. Why?
Abstract (arXiv)
Multi-label topic classification without labeled training data is a challenging task, specially when documents contain complex relational information. We present a zero-shot multi-label topic classification framework and systematically investigate how per-article knowledge graph augmentation affects its performance. The base framework classifies topics in documents without labeled training data and has four variants: article-only classification, keyword-enhanced classification, and self-consistency decoding variants of both. Then, we augment each base variant with per article knowledge graph. This graph is extracted from the input document through a pipeline similar to KGGen based on subject-predicate-object triples. We test all eight methods, four base and four graph augmented on fifteen LLMs and eight multi-label datasets across different domains. For the base framework, keyword-enhanced classification (AK) is the best performing method, and six out of fifteen LLMs surpass the sentence-encoder baseline. Graph augmentation has positive and negative impacts on small and large models, respectively. This shows that larger models already contain enough relational information from pretraining. Furthermore, the self-consistency decoding variant does not show performance improvements in any experiment while increasing computation costs about fivefold.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 77 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
36 of 77 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2024Mixtral of Expertscited by 1,785
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Knowledge Graphscited by 619
24 more
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 111
- 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoningcited by 105
- 2018Weakly-Supervised Neural Text Classificationcited by 66
- 2022Can Large Language Models Truly Understand Prompts? A Case Study with Negated Promptscited by 56
- 2019Zero-shot Text Classification With Generative Language Modelscited by 55
- 2018Zero-shot User Intent Detection via Capsule Neural Networkscited by 54
- 2025KGGen: Extracting Knowledge Graphs from Plain Text with Language Modelscited by 49
- 2019Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classificationcited by 31
- 2023Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?cited by 31
- 2023Better patching using LLM prompting, via Self-Consistencycited by 29
- 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
- 2017Train Once, Test Anywhere: Zero-Shot Learning for Text Classificationcited by 22
- 2023Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarioscited by 18
- 2017Multi-label Dataless Text Classification with Topic Modelingcited by 14
- 2019Towards Automated Sexual Violence Report Trackingcited by 7
- 2016Generalized Topic Modelingcited by 3
- 2025KG-HTC: Integrating Knowledge Graphs into LLMs for Effective Zero-shot Hierarchical Text Classificationcited by 3
- 2025From Haystack to Needle: Label Space Reduction for Zero-shot Classificationcited by 2
- 2024FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domaincited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective
- 2024Retrieval-Augmented Language Model for Extreme Multi-Label Knowledge Graph Link Prediction
- 2025A Zero-shot Learning Method Based on Large Language Models for Multi-modal Knowledge Graph Embedding
- 2024TopicTag: Automatic Annotation of NMF Topic Models Using Chain of Thought and Prompt Tuning with LLMs
- 2026HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification
- 2024Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification
- 2024Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillation
- 2024Distilling Large Language Models for Text-Attributed Graph Learning