mlsanityData to 14 Oct 2026

Federated Continual Graph Learning

arXiv 2411.18919 ↗First posted 28 Nov 2024cs.LG cs.AI cs.DBcited by 5

Not on the map. Why?

Abstract (arXiv)

Managing evolving graph data presents substantial challenges in storage and privacy, and training graph neural networks (GNNs) on such data often leads to catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they rely on centralized architectures and ignore the potential of distributed graph databases to leverage collective intelligence. To this end, we propose Federated Continual Graph Learning (FCGL) to adapt GNNs across multiple evolving graphs under storage and privacy constraints. Our empirical study highlights two core challenges: local graph forgetting (LGF), where clients lose prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To address these, we introduce POWER, a framework that preserves experience nodes with maximum local-global coverage locally to mitigate LGF, and leverages pseudo-prototype reconstruction with trajectory-aware knowledge transfer to resolve GEC. Experiments on various graph datasets demonstrate POWER's superiority over federated adaptations of CGL baselines and vision-centric federated continual learning approaches.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 38 of its 63 references that are in the map. First posted on arXiv 28 Nov 2024.

Builds on

38 of 63 references.

References · 38

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017Graph Attention Networkscited by 8,923
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  7. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
  8. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  9. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
  10. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  11. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  12. 2021Datasets: A Community Library for Natural Language Processingcited by 530
26 more
  1. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  2. 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
  3. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  4. 2021Federated Graph Classification over Non-IID Graphscited by 114
  5. 2020Overcoming Catastrophic Forgetting in Graph Neural Networkscited by 95
  6. 2021Representational Continuity for Unsupervised Continual Learningcited by 95
  7. 2023TARGET: Federated Class-Continual Learning via Exemplar-Free Distillationcited by 65
  8. 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 52
  9. 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
  10. 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
  11. 2021Federated Graph Learning -- A Position Papercited by 35
  12. 2021FedGL: Federated Graph Learning Framework with Global Self-Supervisioncited by 34
  13. 2022DGRec: Graph Neural Network for Recommendation with Diversified Embedding Generationcited by 33
  14. 2024Federated Graph Semantic and Structural Learningcited by 30
  15. 2024AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneitycited by 25
  16. 2022Reinforced Continual Learning for Graphscited by 24
  17. 2021Continual Learning for Image-Based Camera Localizationcited by 18
  18. 2024Towards Robust Graph Incremental Learning on Evolving Graphscited by 18
  19. 2022Federated Graph Machine Learning: A Survey of Concepts, Techniques, and Applicationscited by 14
  20. 2024Deep Efficient Private Neighbor Generation for Subgraph Federated Learningcited by 14
  21. 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
  22. 2024DSLR: Diversity Enhancement and Structure Learning for Rehearsal-based Graph Continual Learningcited by 14
  23. 2024Replay-and-Forget-Free Graph Class-Incremental Learning: A Task Profiling and Prompting Approachcited by 12
  24. 2023Graph-less Collaborative Filteringcited by 11
  25. 2024A Topology-aware Graph Coarsening Framework for Continual Graph Learningcited by 11
  26. 2023Privacy-Preserving Graph Machine Learning from Data to Computation: A Surveycited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.