mlsanityData to 7 Oct 2026

Open-World Lifelong Graph Learning

arXiv 2310.12565 ↗First posted 19 Oct 2023cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt existing non-graph OOD detection methods to graph data. Crucially, we suggest performing new class detection by combining OOD detection methods with information aggregated from the graph neighborhood. Most OOD detection methods avoid determining a crisp threshold for deciding whether a vertex is OOD. To tackle this problem, we propose a Weakly-supervised Relevance Feedback (Open-WRF) method, which decreases the sensitivity to thresholds in OOD detection. We evaluate our approach on six benchmark datasets. Our results show that the proposed neighborhood aggregation method for OOD scores outperforms existing methods independent of the underlying graph neural network. Furthermore, we demonstrate that our Open-WRF method is more robust to threshold selection and analyze the influence of graph neighborhood on OOD detection. The aggregation and threshold methods are compatible with arbitrary graph neural networks and OOD detection methods, making our approach versatile and applicable to many real-world applications.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 19 Oct 2023.

Builds on

29 of 43 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  9. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  10. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  11. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  12. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
17 more
  1. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  2. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
  3. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  4. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  5. 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
  6. 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
  7. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
  8. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 242
  9. 2017DOC: Deep Open Classification of Text Documentscited by 109
  10. 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
  11. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
  12. 2021Graph-MLP: Node Classification without Message Passing in Graphcited by 73
  13. 2020Lifelong Graph Learningcited by 31
  14. 2022Graph Lifelong Learning: A Surveycited by 30
  15. 2023Learning on Graphs with Out-of-Distribution Nodescited by 29
  16. 2020Lifelong Learning of Graph Neural Networks for Open-World Node Classificationcited by 22
  17. 2021The Popularity-Homophily Index: A new way to measure Homophily in Directed Graphscited by 1

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.