mlsanityData to 14 Oct 2026

HERO: Preserving Structure and Semantics in Heterogeneous Continual Graph Learning

arXiv 2505.17458 ↗First posted 23 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Machine learning on heterogeneous graphs has advanced rapidly, driven by the diverse entities, relations, and semantics inherent in real-world data. However, most existing studies assume static graphs, whereas real-world graph data are often continuously updated. Continual learning in this setting is particularly challenging because historical knowledge is encoded not only in target-node representations, but also in their heterogeneous structural contexts and relation-dependent semantic responses. To this end, we introduce HERO, a heterogeneous continual graph learning framework that preserves historical knowledge at both structural and semantic levels while adapting to incoming tasks. We analyze experience replay as an approximation to the unavailable historical gradient and decompose its error into target-selection and context-reconstruction terms. This analysis shows that replaying target nodes alone is generally insufficient for relation-sensitive HGNNs, as removing typed neighborhood context can alter both representations and historical gradients. Motivated by this, HERO employs DiSCo to select representative target nodes and reconstruct compact heterogeneous contexts through relation-aware multi-type neighbor expansion. To further preserve knowledge that cannot be captured by replayed subgraphs alone, HERO aligns task-conditioned predictions and heterogeneous semantic responses through multi-level knowledge distillation. A lightweight look-ahead adaptation step is additionally used to improve plasticity on incoming tasks. Experiments on four datasets with three HGNN backbones show that HERO achieves the best or tied-best average performance among state-of-the-art baselines, while maintaining competitive forgetting. Our code is available at https://github.com/gqBond/HCGL.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

31 of 55 references.

References · 31

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  5. 2016Learning without Forgettingcited by 2,496
  6. 2016Matching Networks for One Shot Learningcited by 2,255
  7. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  8. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  9. 2019Heterogeneous Graph Attention Networkcited by 734
  10. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
  11. 2020Heterogeneous Graph Transformercited by 582
  12. 2019Graph Transformer Networkscited by 523
19 more
  1. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  2. 2019Meta-Learning Representations for Continual Learningcited by 189
  3. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  4. 2017Heterogeneous Information Network Embedding for Recommendationcited by 133
  5. 2020Overcoming Catastrophic Forgetting in Graph Neural Networkscited by 95
  6. 2019An Attention-based Graph Neural Network for Heterogeneous Structural Learningcited by 71
  7. 2022Simple and Efficient Heterogeneous Graph Neural Networkcited by 71
  8. 2020GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systemscited by 42
  9. 2023Knowledge Distillation on Graphs: A Surveycited by 38
  10. 2023Continual Learning on Dynamic Graphs via Parameter Isolationcited by 36
  11. 2021Hierarchical Prototype Networks for Continual Graph Representation Learningcited by 28
  12. 2024Continual Learning on Graphs: Challenges, Solutions, and Opportunitiescited by 21
  13. 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
  14. 2024DSLR: Diversity Enhancement and Structure Learning for Rehearsal-based Graph Continual Learningcited by 14
  15. 2024A Topology-aware Graph Coarsening Framework for Continual Graph Learningcited by 11
  16. 2023Universal Graph Continual Learningcited by 9
  17. 2024Towards Continuous Reuse of Graph Models via Holistic Memory Diversificationcited by 7
  18. 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networkscited by 4
  19. 2024FTF-ER: Feature-Topology Fusion-Based Experience Replay Method for Continual Graph Learningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Task-Aware Adaptive Modulation: A Replay-Free and Resource-Efficient Approach For Continual Graph Learning
  2. 2026SAOT: Self-Supervised Continual Graph Learning with Structure-Aware Optimal Transport
  3. 2023Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning
  4. 2026MAEM: Mitigating Recency Bias via a Replay-Free, Capacity-Controlled Dynamic Mixture of Experts for Class-Incremental Graph Learning
  5. 2025A Generative Adaptive Replay Continual Learning Model for Temporal Knowledge Graph Reasoning
  6. 2026Dynamic Graph World Modelling: Learning Future Dynamics from Temporal Context
  7. 2023Heterogeneous Continual Learning
  8. 2025Towards Efficient LLM-aware Heterogeneous Graph Learning