Harnessing Feature Resonance under Arbitrary Target Alignment for Out-of-Distribution Node Detection
Not on the map. Why?
Abstract (arXiv)
Detecting out-of-distribution (OOD) nodes in the graph-based machine-learning field is challenging, particularly when in-distribution (ID) node multi-category labels are unavailable. Thus, we focus on feature space rather than label space and find that, ideally, during the optimization of known ID samples, unknown ID samples undergo more significant representation changes than OOD samples, even if the model is trained to fit random targets, which we called the Feature Resonance phenomenon. The rationale behind it is that even without gold labels, the local manifold may still exhibit smooth resonance. Based on this, we further develop a novel graph OOD framework, dubbed Resonance-based Separation and Learning (RSL), which comprises two core modules: (i) a more practical micro-level proxy of feature resonance that measures the movement of feature vectors in one training step. (ii) integrate with synthetic OOD nodes strategy to train an effective OOD classifier. Theoretically, we derive an error bound showing the superior separability of OOD nodes during the resonance period. Extensive experiments on a total of thirteen real-world graph datasets empirically demonstrate that RSL achieves state-of-the-art performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 67 of its 93 references that are in the map. First posted on arXiv 22 Feb 2025.
Builds on
67 of 93 references.
References · 67
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2020Supervised Contrastive Learningcited by 2,829
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
38 more
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2015Deep Learning and the Information Bottleneck Principlecited by 802
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2015Towards Open Set Deep Networkscited by 538
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2018MolGAN: An implicit generative model for small molecular graphscited by 393
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 250
- 2020Classification-Based Anomaly Detection for General Datacited by 211
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2020ATOM: Robustifying Out-of-distribution Detection Using Outlier Miningcited by 116
- 2013From Amateurs to Connoisseurs: Modeling the Evolution of User Expertise through Online Reviewscited by 108
- 2022POEM: Out-of-Distribution Detection with Posterior Samplingcited by 108
- 2020Feature Purification: How Adversarial Training Performs Robust Deep Learningcited by 107
- 2021Neural Transformation Learning for Deep Anomaly Detection Beyond Imagescited by 99
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
- 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
- 2022Benign Overfitting in Two-layer Convolutional Neural Networkscited by 91
- 2014Propagation Kernelscited by 88
- 2022Training OOD Detectors in their Natural Habitatscited by 86
- 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 80
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.