Towards Anomaly-Aware Pre-Training and Fine-Tuning for Graph Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Graph anomaly detection (GAD) has garnered increasing attention in recent years, yet remains challenging due to two key factors: (1) label scarcity stemming from the high cost of annotations and (2) homophily disparity at node and class levels. In this paper, we introduce Anomaly-Aware Pre-Training and Fine-Tuning (APF), a targeted and effective framework to mitigate the above challenges in GAD. In the pre-training stage, APF incorporates node-specific subgraphs selected via the Rayleigh Quotient, a label-free anomaly metric, into the learning objective to enhance anomaly awareness. It further introduces two learnable spectral polynomial filters to jointly learn dual representations that capture both general semantics and subtle anomaly cues. During fine-tuning, a gated fusion mechanism adaptively integrates pre-trained representations across nodes and dimensions, while an anomaly-aware regularization loss encourages abnormal nodes to preserve more anomaly-relevant information. Furthermore, we theoretically show that APF tends to achieve linear separability under mild conditions. Comprehensive experiments on 10 benchmark datasets validate the superior performance of APF in comparison to state-of-the-art baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 66 of its 93 references that are in the map. First posted on arXiv 19 Apr 2025.
Builds on
66 of 93 references.
References · 66
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2018Deep Graph Infomaxcited by 1,106
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
38 more
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 250
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2022Rethinking Graph Neural Networks for Anomaly Detectioncited by 187
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
- 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 177
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2019Anti-Money Laundering in Bitcoin: Experimenting with Graph Convolutional Networks for Financial Forensicscited by 164
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 141
- 2018Contextual Stochastic Block Modelscited by 134
- 2013Consistency of spectral clustering in stochastic block modelscited by 129
- 2013From Amateurs to Connoisseurs: Modeling the Evolution of User Expertise through Online Reviewscited by 108
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
- 2021Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalizationcited by 70
- 2021Few-shot Network Anomaly Detection via Cross-network Meta-learningcited by 64
- 2022DGraph: A Large-Scale Financial Dataset for Graph Anomaly Detectioncited by 63
- 2019Deep Weakly-supervised Anomaly Detectioncited by 59
- 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detectioncited by 58
- 2019Spam Review Detection with Graph Convolutional Networkscited by 57
- 2024ARC: A Generalist Graph Anomaly Detector with In-Context Learningcited by 48
- 2021AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filtercited by 43
- 2023Truncated Affinity Maximization: One-class Homophily Modeling for Graph Anomaly Detectioncited by 43
- 2023Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?cited by 41
- 2024Deep Graph Anomaly Detection: A Survey and New Perspectivescited by 40
- 2022Cross-Domain Graph Anomaly Detection via Anomaly-aware Contrastive Alignmentcited by 31
- 2024Zero-shot Generalist Graph Anomaly Detection with Unified Neighborhood Promptscited by 28
- 2022EvenNet: Ignoring Odd-Hop Neighbors Improves Robustness of Graph Neural Networkscited by 26
- 2024Graph Neural Networks for Financial Fraud Detection: A Reviewcited by 25
- 2024Partitioning Message Passing for Graph Fraud Detectioncited by 23
- 2025AnomalyGFM: Graph Foundation Model for Zero/Few-shot Anomaly Detectioncited by 23
- 2024Generative Semi-supervised Graph Anomaly Detectioncited by 22
- 2023Rayleigh Quotient Graph Neural Networks for Graph-level Anomaly Detectioncited by 19
50 most cited of 66 All 66 (JSON)
Built on by
Not cited yet.