Graph Synthetic Out-of-Distribution Exposure with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection in graphs is critical for ensuring model robustness in open-world and safety-sensitive applications. Existing graph OOD detection approaches typically train an in-distribution (ID) classifier on ID data alone, then apply post-hoc scoring to detect OOD instances. While OOD exposure - adding auxiliary OOD samples during training - can improve detection, current graph-based methods often assume access to real OOD nodes, which is often impractical or costly. In this paper, we present GOE-LLM, a framework that leverages Large Language Models (LLMs) to achieve OOD exposure on text-attributed graphs without using any real OOD nodes. GOE-LLM introduces two pipelines: (1) identifying pseudo-OOD nodes from the initially unlabeled graph using zero-shot LLM annotations, and (2) generating semantically informative synthetic OOD nodes via LLM-prompted text generation. These pseudo-OOD nodes are then used to regularize ID classifier training and enhance OOD detection awareness. Empirical results on multiple benchmarks show that GOE-LLM substantially outperforms state-of-the-art methods without OOD exposure, achieving up to a 23.5% improvement in AUROC for OOD detection, and attains performance on par with those relying on real OOD labels for exposure.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 37 references that are in the map. First posted on arXiv 29 Apr 2025.
Builds on
30 of 37 references.
References · 30
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
- 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
- 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
- 2023Non-Parametric Outlier Synthesiscited by 129
- 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
- 2022A Survey on Deep Graph Generation: Methods and Applicationscited by 69
18 more
- 2023Energy-based Out-of-Distribution Detection for Graph Neural Networkscited by 68
- 2021Mixture Outlier Exposure: Towards Out-of-Distribution Detection in Fine-grained Environmentscited by 66
- 2019Out-of-distribution Detection in Classifiers via Generationcited by 49
- 2020TIMME: Twitter Ideology-detection via Multi-task Multi-relational Embeddingcited by 39
- 2024How Does Unlabeled Data Provably Help Out-of-Distribution Detection?cited by 36
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detectioncited by 32
- 2020Further Analysis of Outlier Detection with Deep Generative Modelscited by 31
- 2023Learning on Graphs with Out-of-Distribution Nodescited by 29
- 2024DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detectioncited by 29
- 2024MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalitiescited by 28
- 2024MetaOOD: Automatic Selection of OOD Detection Modelscited by 16
- 2020AutoAudit: Mining Accounting and Time-Evolving Graphscited by 15
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generationcited by 15
- 2024LEGO-Learn: Label-Efficient Graph Open-Set Learningcited by 10
- 2020Graph Partitioning and Graph Neural Network based Hierarchical Graph Matching for Graph Similarity Computationcited by 8
- 2025Few-Shot Graph Out-of-Distribution Detection with LLMscited by 6
- 2025Out-of-Distribution Detection using Synthetic Data Generationcited by 4
- 2020CoSimGNN: Towards Large-scale Graph Similarity Computationcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2026Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Biascited by 3
- 2025LLM-Powered Text-Attributed Graph Anomaly Detection via Retrieval-Augmented Reasoningcited by 2
- 2025When LLMs meet open-world graph learning: a new perspective for unlabeled data uncertaintycited by 1
- 2025A Systematic Study of Model Extraction Attacks on Graph Foundation Modelscited by 1
- 2026What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decompositioncited by 1
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMscited by 0
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs10 Sep 2026
- 2026Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias13 Jul 2026
- 2026What Information Matters? Graph Out-of-Distribution Detection via Tri-Component Information Decomposition13 May 2026
- 2025LLM-Powered Text-Attributed Graph Anomaly Detection via Retrieval-Augmented Reasoning16 Nov 2025
- 2025A Systematic Study of Model Extraction Attacks on Graph Foundation Models14 Nov 2025
- 2025When LLMs meet open-world graph learning: a new perspective for unlabeled data uncertainty20 May 2025