mlsanityData to 7 Oct 2026

Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimation

arXiv 2407.19944 ↗First posted 29 Jul 2024cs.LG cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Unsupervised graph representation learning (UGRL) based on graph neural networks (GNNs), has received increasing attention owing to its efficacy in handling graph-structured data. However, existing UGRL methods ideally assume that the node features are noise-free, which makes them fail to distinguish between useful information and noise when applied to real data with noisy features, thus affecting the quality of learned representations. This urges us to take node noisy features into account in real-world UGRL. With empirical analysis, we reveal that feature propagation, the essential operation in GNNs, acts as a "double-edged sword" in handling noisy features - it can both denoise and diffuse noise, leading to varying feature quality across nodes, even within the same node at different hops. Building on this insight, we propose a novel UGRL method based on Multi-hop feature Quality Estimation (MQE for short). Unlike most UGRL models that directly utilize propagation-based GNNs to generate representations, our approach aims to learn representations through estimating the quality of propagated features at different hops. Specifically, we introduce a Gaussian model that utilizes a learnable "meta-representation" as a condition to estimate the expectation and variance of multi-hop propagated features via neural networks. In this way, the "meta representation" captures the semantic and structural information underlying multiple propagated features but is naturally less susceptible to interference by noise, thereby serving as high-quality node representations beneficial for downstream tasks. Extensive experiments on multiple real-world datasets demonstrate that MQE in learning reliable node representations in scenarios with diverse types of feature noise.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 29 Jul 2024.

Builds on

44 of 61 references.

References · 44

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  5. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  6. 2019Simplifying Graph Convolutional Networkscited by 1,470
  7. 2016Variational Graph Auto-Encoderscited by 1,373
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  9. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  10. 2018Deep Graph Infomaxcited by 1,101
  11. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  12. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
32 more
  1. 2020Deep Graph Contrastive Representation Learningcited by 535
  2. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  3. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  4. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
  5. 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
  6. 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
  7. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  8. 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 212
  9. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
  10. 2021An Empirical Study of Graph Contrastive Learningcited by 113
  11. 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
  12. 2019Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Drivingcited by 105
  13. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  14. 2018Adversarially Regularized Graph Autoencoder for Graph Embeddingcited by 84
  15. 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
  16. 2022Graph Attention Multi-Layer Perceptroncited by 82
  17. 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
  18. 2024ARC: A Generalist Graph Anomaly Detector with In-Context Learningcited by 46
  19. 2020Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Predictioncited by 41
  20. 2022COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learningcited by 38
  21. 2020Graph Enhanced Representation Learning for News Recommendationcited by 30
  22. 2022Uncertainty-Aware Multi-View Representation Learningcited by 29
  23. 2022MGAE: Masked Autoencoders for Self-Supervised Learning on Graphscited by 27
  24. 2022Model Degradation Hinders Deep Graph Neural Networkscited by 26
  25. 2023Learning Strong Graph Neural Networks with Weak Informationcited by 25
  26. 2023Integrating Graphs with Large Language Models: Methods and Prospectscited by 18
  27. 2024Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmarkcited by 18
  28. 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labelscited by 17
  29. 2023Reinforcement Graph Clustering with Unknown Cluster Numbercited by 16
  30. 2024Self-Supervision Improves Diffusion Models for Tabular Data Imputationcited by 16
  31. 2024End-to-end Learnable Clustering for Intent Learning in Recommendationcited by 10
  32. 2022Robust Graph Representation Learning for Local Corruption Recoverycited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 4.

11 papers.