EdgePruner: Poisoned Edge Pruning in Graph Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Graph Contrastive Learning (GCL) is unsupervised graph representation learning that can obtain useful representation of unknown nodes. The node representation can be utilized as features of downstream tasks. However, GCL is vulnerable to poisoning attacks as with existing learning models. A state-of-the-art defense cannot sufficiently negate adverse effects by poisoned graphs although such a defense introduces adversarial training in the GCL. To achieve further improvement, pruning adversarial edges is important. To the best of our knowledge, the feasibility remains unexplored in the GCL domain. In this paper, we propose a simple defense for GCL, EdgePruner. We focus on the fact that the state-of-the-art poisoning attack on GCL tends to mainly add adversarial edges to create poisoned graphs, which means that pruning edges is important to sanitize the graphs. Thus, EdgePruner prunes edges that contribute to minimizing the contrastive loss based on the node representation obtained after training on poisoned graphs by GCL. Furthermore, we focus on the fact that nodes with distinct features are connected by adversarial edges in poisoned graphs. Thus, we introduce feature similarity between neighboring nodes to help more appropriately determine adversarial edges. This similarity is helpful in further eliminating adverse effects from poisoned graphs on various datasets. Finally, EdgePruner outputs a graph that yields the minimum contrastive loss as the sanitized graph. Our results demonstrate that pruning adversarial edges is feasible on six datasets. EdgePruner can improve the accuracy of node classification under the attack by up to 5.55% compared with that of the state-of-the-art defense. Moreover, we show that EdgePruner is immune to an adaptive attack.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 53 references that are in the map. First posted on arXiv 12 Dec 2023.
Builds on
41 of 53 references.
References · 41
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
29 more
- 2019Contrastive Multiview Codingcited by 1,297
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2019Neural Graph Collaborative Filteringcited by 660
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 395
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
- 2019Adversarial Attacks on Graph Neural Networks via Meta Learningcited by 261
- 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 249
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2019Topology Attack and Defense for Graph Neural Networks: An Optimization Perspectivecited by 196
- 2020GNNGuard: Defending Graph Neural Networks against Adversarial Attackscited by 195
- 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
- 2020Disentangled Graph Collaborative Filteringcited by 118
- 2018Adversarial Attacks on Node Embeddings via Graph Poisoningcited by 109
- 2019A Mutual Information Maximization Perspective of Language Representation Learningcited by 85
- 2019Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systemscited by 41
- 2022Adversarial Graph Contrastive Learning with Information Regularizationcited by 38
- 2022Unsupervised Graph Poisoning Attack via Contrastive Loss Back-propagationcited by 25
- 2021Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systemscited by 24
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024SoK: Blockchain-Based Decentralized AI (DeAI)cited by 6
- 2024SoK: Blockchain-Based Decentralized AI (DeAI)26 Nov 2024