mlsanityData to 7 Oct 2026

HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification

arXiv 2604.17271 ↗First posted 19 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy dependence on labeled data, limiting their effectiveness in label-scarce settings. While large language models (LLMs) naturally address the text understanding gap with deep semantic reasoning, existing LLM-for-graph methods either still require abundant labels during training or fail to exploit the rich structural signals freely available in graph topology. Our key observation is that, in many real-world TAGs, edges predominantly connect similar nodes under the homophily principle, meaning graph topology inherently encodes class structure without any labels. Building on this insight, we reformulate node classification as a link prediction task and present HopRank, a fully self-supervised LLM-tuning framework for TAGs. HopRank constructs preference data via hierarchical hop-based sampling and employs adaptive preference learning to prioritize informative training signals without any class labels. At inference, nodes are classified by predicting their connection preferences to labeled anchors, with an adaptive early-exit voting scheme to improve efficiency. Experiments on three TAG benchmarks show that HopRank matches fully-supervised GNNs and substantially outperforms prior graph-LLM methods, despite using zero labeled training data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 39 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

32 of 39 references.

References · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2017Graph Attention Networkscited by 8,854
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2017Inductive Representation Learning on Large Graphscited by 6,284
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2019Simplifying Graph Convolutional Networkscited by 1,470
  10. 2018Deep Graph Infomaxcited by 1,101
  11. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  12. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
20 more
  1. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
  2. 2020Deep Graph Contrastive Representation Learningcited by 535
  3. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  4. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  5. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  6. 2023Language is All a Graph Needscited by 219
  7. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
  8. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  9. 2024LLaGA: Large Language and Graph Assistantcited by 177
  10. 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 153
  11. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
  12. 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
  13. 2020Graph Meta Learning via Local Subgraphscited by 89
  14. 2020Be More with Less: Hypergraph Attention Networks for Inductive Text Classificationcited by 73
  15. 2024InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignmentcited by 56
  16. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 56
  17. 2025When Do LLMs Help With Node Classification? A Comprehensive Analysiscited by 21
  18. 2025A Survey of Large Language Models for Text-Guided Molecular Discovery: from Molecule Generation to Optimizationcited by 12
  19. 2025POLO: Preference-Guided Multi-Turn Reinforcement Learning for Lead Optimizationcited by 10
  20. 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimizationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Preference-driven Knowledge Distillation for Few-shot Node Classification
  2. 2024Similarity-based Neighbor Selection for Graph LLMs
  3. 2025Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications
  4. 2026Turning Semantics into Topology: LLM-Driven Attribute Augmentation for Collaborative Filtering
  5. 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining
  6. 2025NOCL: Node-Oriented Conceptualization LLM for Graph Tasks without Message Passing
  7. 2026TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learning
  8. 2026Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression