mlsanityData to 14 Oct 2026

Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs

arXiv 2508.08769 ↗First posted 12 Aug 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In semi-supervised learning (SSL) for enhancing the performance of graph neural networks (GNNs) with unlabeled data, introducing mutually independent decision factors for cross-validation is regarded as an effective strategy to alleviate pseudo-label confirmation bias and training collapse. However, obtaining such factors is challenging in practice: additional and valid information sources are inherently scarce, and even when such sources are available, their independence from the original source cannot be guaranteed. To address this challenge, In this paper we propose a Differentiated Factor Consistency Semi-supervised Framework (DiFac), which derives differentiated factors from a single information source and enforces their consistency. During pre-training, the model learns to extract these factors; in training, it iteratively removes samples with conflicting factors and ranks pseudo-labels based on the shortest stave principle, selecting the top candidate samples to reduce overconfidence commonly observed in confidence-based or ensemble-based methods. Our framework can also incorporate additional information sources. In this work, we leverage the large multimodal language model to introduce latent textual knowledge as auxiliary decision factors, and we design a accountability scoring mechanism to mitigate additional erroneous judgments introduced by these auxiliary factors. Experiments on multiple benchmark datasets demonstrate that DiFac consistently improves robustness and generalization in low-label regimes, outperforming other baseline methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

22 of 33 references.

References · 22

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  5. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  6. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  7. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
  8. 2020Simple and Deep Graph Convolutional Networkscited by 860
  9. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
  10. 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
  11. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  12. 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
10 more
  1. 2019Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labelscited by 111
  2. 2023Contextual Object Detection with Multimodal Large Language Modelscited by 100
  3. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 92
  4. 2020Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learningcited by 43
  5. 2020CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understandingcited by 41
  6. 2022Informative Pseudo-Labeling for Graph Neural Networks with Few Labelscited by 19
  7. 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classificationcited by 11
  8. 2022PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated Catalyst Designcited by 6
  9. 2022Binary Graph Convolutional Network with Capacity Explorationcited by 4
  10. 2023Pseudo Contrastive Learning for Graph-based Semi-supervised Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework
  2. 2025DiffGraph: Heterogeneous Graph Diffusion Model
  3. 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining
  4. 2024GNNAnatomy: Rethinking Model-Level Explanations for Graph Neural Networks
  5. 2021Multi-task Self-distillation for Graph-based Semi-Supervised Learning
  6. 2023Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks
  7. 2018Mixture of Expert/Imitator Networks: Scalable Semi-supervised Learning Framework
  8. 2023Towards Fine-Grained Explainability for Heterogeneous Graph Neural Network