mlsanityData to 14 Oct 2026

State Space Models over Directed Graphs

arXiv 2509.13735 ↗First posted 17 Sep 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Directed graphs are ubiquitous across numerous domains, where the directionality of edges encodes critical causal dependencies. However, existing GNNs and graph Transformers tailored for directed graphs face two major challenges: (1) effectively capturing long-range causal dependencies derived from directed edges; (2) balancing accuracy and training efficiency when processing large-scale graph datasets. In recent years, state space models (SSMs) have achieved substantial progress in causal sequence tasks, and their variants designed for graphs have demonstrated state-of-the-art accuracy while maintaining high efficiency across various graph learning benchmarks. However, existing graph state space models are exclusively designed for undirected graphs, which limits their performance in directed graph learning. To this end, we propose an innovative approach DirEgo2Token which sequentializes directed graphs via k-hop ego graphs. This marks the first systematic extension of state space models to the field of directed graph learning. Building upon this, we develop DirGraphSSM, a novel directed graph neural network architecture that implements state space models on directed graphs via the message-passing mechanism. Experimental results demonstrate that DirGraphSSM achieves state-of-the-art performance on three representative directed graph learning tasks while attaining competitive performance on two additional tasks with 1.5× to 2× training speed improvements compared to existing state-of-the-art models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

46 of 62 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2017Graph Attention Networkscited by 8,923
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  9. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
34 more
  1. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  2. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  3. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  4. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  5. 2020A Generalization of Transformer Networks to Graphscited by 661
  6. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  7. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
  8. 2017Residual Gated Graph ConvNetscited by 346
  9. 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
  10. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
  11. 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
  12. 2023Exphormer: Sparse Transformers for Graphscited by 170
  13. 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
  14. 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
  15. 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
  16. 2021MagNet: A Neural Network for Directed Graphscited by 107
  17. 2019D-VAE: A Variational Autoencoder for Directed Acyclic Graphscited by 98
  18. 2023Edge Directionality Improves Learning on Heterophilic Graphscited by 90
  19. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
  20. 2020Rotate to Attend: Convolutional Triplet Attention Modulecited by 75
  21. 2020Directed Graph Convolutional Networkcited by 73
  22. 2021Directed Acyclic Graph Neural Networkscited by 70
  23. 2023CktGNN: Circuit Graph Neural Network for Electronic Design Automationcited by 58
  24. 2020A Large-Scale Database for Graph Representation Learningcited by 55
  25. 2023Effectively Modeling Time Series with Simple Discrete State Spacescited by 54
  26. 2023Transformers Meet Directed Graphscited by 40
  27. 2022High-Level Synthesis Performance Prediction using GNNs: Benchmarking, Modeling, and Advancingcited by 26
  28. 2022Transformers over Directed Acyclic Graphscited by 23
  29. 2022PACE: A Parallelizable Computation Encoder for Directed Acyclic Graphscited by 20
  30. 2023HoloNets: Spectral Convolutions do extend to Directed Graphscited by 20
  31. 2023Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classificationcited by 19
  32. 2021DIGRAC: Digraph Clustering Based on Flow Imbalancecited by 15
  33. 2021D-HYPR: Harnessing Neighborhood Modeling and Asymmetry Preservation for Digraph Representation Learningcited by 8
  34. 2024What Are Good Positional Encodings for Directed Graphs?cited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024What Can We Learn from State Space Models for Machine Learning on Graphs?
  2. 2025Message-Passing State-Space Models: Improving Graph Learning with Modern Sequence Modeling
  3. 2024State Space Models on Temporal Graphs: A First-Principles Study
  4. 2024HeteGraph-Mamba: Heterogeneous Graph Learning via Selective State Space Model
  5. 2026COMBA: Cross Batch Aggregation for Learning Large Graphs with Context Gating State Space Models
  6. 2025Generating Directed Graphs with Dual Attention and Asymmetric Encoding
  7. 2025GKNet: Graph Kalman Filtering and Model Inference via Model-based Deep Learning
  8. 2024GraphEdit: Large Language Models for Graph Structure Learning