Text2Graph: Combining Lightweight LLMs and GNNs for Efficient Text Classification in Label-Scarce Scenarios
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have become effective zero-shot classifiers, but their high computational requirements and environmental costs limit their practicality for large-scale annotation in high-performance computing (HPC) environments. To support more sustainable workflows, we present Text2Graph, an open-source Python package that provides a modular implementation of existing text-to-graph classification approaches. The framework enables users to combine LLM-based partial annotation with Graph Neural Network (GNN) label propagation in a flexible manner, making it straightforward to swap components such as feature extractors, edge construction methods, and sampling strategies. We benchmark Text2Graph on a zero-shot setting using five datasets spanning topic classification and sentiment analysis tasks, comparing multiple variants against other zero-shot approaches for text classification. In addition to reporting performance, we provide detailed estimates of energy consumption and carbon emissions, showing that graph-based propagation achieves competitive results at a fraction of the energy and environmental cost.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
16 of 24 references.
References · 16
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2023A Survey of Large Language Modelscited by 2,537
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
- 2023Language is All a Graph Needscited by 219
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
- 2025How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencecited by 73
- 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
- 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 57
4 more
- 2024Pushing The Limit of LLM Capacity for Text Classificationcited by 28
- 2024Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learningcited by 21
- 2023Graph Neural Networks for Text Classification: A Surveycited by 15
- 2024Text Classification using Graph Convolutional Networks: A Comprehensive Surveycited by 1
Built on by
Not cited yet.