mlsanityData to 7 Oct 2026

Text2Graph: Combining Lightweight LLMs and GNNs for Efficient Text Classification in Label-Scarce Scenarios

arXiv 2512.10061 ↗First posted 10 Dec 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have become effective zero-shot classifiers, but their high computational requirements and environmental costs limit their practicality for large-scale annotation in high-performance computing (HPC) environments. To support more sustainable workflows, we present Text2Graph, an open-source Python package that provides a modular implementation of existing text-to-graph classification approaches. The framework enables users to combine LLM-based partial annotation with Graph Neural Network (GNN) label propagation in a flexible manner, making it straightforward to swap components such as feature extractors, edge construction methods, and sampling strategies. We benchmark Text2Graph on a zero-shot setting using five datasets spanning topic classification and sentiment analysis tasks, comparing multiple variants against other zero-shot approaches for text classification. In addition to reporting performance, we provide detailed estimates of energy consumption and carbon emissions, showing that graph-based propagation achieves competitive results at a fraction of the energy and environmental cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

16 of 24 references.

References · 16

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  5. 2018Graph Convolutional Networks for Text Classificationcited by 345
  6. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  7. 2023Language is All a Graph Needscited by 219
  8. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  9. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
  10. 2025How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencecited by 73
  11. 2023Label-free Node Classification on Graphs with Large Language Models (LLMS)cited by 72
  12. 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 57
4 more
  1. 2024Pushing The Limit of LLM Capacity for Text Classificationcited by 28
  2. 2024Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learningcited by 21
  3. 2023Graph Neural Networks for Text Classification: A Surveycited by 15
  4. 2024Text Classification using Graph Convolutional Networks: A Comprehensive Surveycited by 1

Built on by

Not cited yet.