mlsanityData to 14 Oct 2026

Rule Learning for Knowledge Graph Reasoning under Agnostic Distribution Shift

arXiv 2507.05110 ↗First posted 7 Jul 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Logical rule learning, a prominent category of knowledge graph (KG) reasoning methods, constitutes a critical research area aimed at learning explicit rules from observed facts to infer missing knowledge. However, like all KG reasoning methods, rule learning suffers from a critical weakness-its dependence on the I.I.D. assumption. This assumption can easily be violated due to selection bias during training or agnostic distribution shifts during testing (e.g., as in query shift scenarios), ultimately undermining model performance and reliability. To enable robust KG reasoning in wild environments, this study investigates logical rule learning in the presence of agnostic test-time distribution shifts. We formally define this challenge as out-of-distribution (OOD) KG reasoning-a previously underexplored problem, and propose the Stable Rule Learning (StableRule) framework as a solution. StableRule is an end-to-end framework that combines feature decorrelation with rule learning network, to enhance OOD generalization in KG reasoning. By leveraging feature decorrelation, StableRule mitigates the adverse effects of covariate shifts arising in OOD scenarios, improving the robustness of the rule learning network. Extensive experiments on seven benchmark KGs demonstrate the framework's superior effectiveness and stability across diverse heterogeneous environments, highlighting its practical significance for real-world applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 75 references that are in the map. First posted on arXiv 7 Jul 2025.

Builds on

39 of 75 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  4. 2019Invariant Risk Minimizationcited by 1,854
  5. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  6. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  7. 2016Complex Embeddings for Simple Link Predictioncited by 902
  8. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  9. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  10. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  11. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 450
  12. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
27 more
  1. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
  2. 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 343
  3. 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 294
  4. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
  5. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  6. 2019Episodic Training for Domain Generalizationcited by 245
  7. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
  8. 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
  9. 2017End-to-End Differentiable Provingcited by 161
  10. 2019Learning to Optimize Domain Specific Normalization for Domain Generalizationcited by 161
  11. 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
  12. 2020Efficient Domain Generalization via Common-Specific Low-Rank Decompositioncited by 134
  13. 2020An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Modelscited by 134
  14. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 124
  15. 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 118
  16. 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
  17. 2021Size-Invariant Graph Representations for Graph Classification Extrapolationscited by 84
  18. 2021OOD-GNN: Out-of-Distribution Generalized Graph Neural Networkcited by 78
  19. 2019Stable Learning via Sample Reweightingcited by 70
  20. 2019Domain Generalization via Multidomain Discriminant Analysiscited by 69
  21. 2020Stable Prediction with Model Misspecification and Agnostic Distribution Shiftcited by 62
  22. 2016Approximate Residual Balancing: De-Biased Inference of Average Treatment Effects in High Dimensionscited by 50
  23. 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
  24. 2023Neural Compositional Rule Learning for Knowledge Graph Reasoningcited by 20
  25. 2021A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalizationcited by 19
  26. 2020Relational Learning Analysis of Social Politics using Knowledge Graph Embeddingcited by 10
  27. 2022Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspectivecited by 4

Built on by

Not cited yet.