State Space Models over Directed Graphs
Not on the map. Why?
Abstract (arXiv)
Directed graphs are ubiquitous across numerous domains, where the directionality of edges encodes critical causal dependencies. However, existing GNNs and graph Transformers tailored for directed graphs face two major challenges: (1) effectively capturing long-range causal dependencies derived from directed edges; (2) balancing accuracy and training efficiency when processing large-scale graph datasets. In recent years, state space models (SSMs) have achieved substantial progress in causal sequence tasks, and their variants designed for graphs have demonstrated state-of-the-art accuracy while maintaining high efficiency across various graph learning benchmarks. However, existing graph state space models are exclusively designed for undirected graphs, which limits their performance in directed graph learning. To this end, we propose an innovative approach DirEgo2Token which sequentializes directed graphs via k-hop ego graphs. This marks the first systematic extension of state space models to the field of directed graph learning. Building upon this, we develop DirGraphSSM, a novel directed graph neural network architecture that implements state space models on directed graphs via the message-passing mechanism. Experimental results demonstrate that DirGraphSSM achieves state-of-the-art performance on three representative directed graph learning tasks while attaining competitive performance on two additional tasks with 1.5× to 2× training speed improvements compared to existing state-of-the-art models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 17 Sep 2025.
Builds on
46 of 62 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
34 more
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020A Generalization of Transformer Networks to Graphscited by 661
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2017Residual Gated Graph ConvNetscited by 346
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
- 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
- 2023Exphormer: Sparse Transformers for Graphscited by 170
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
- 2021MagNet: A Neural Network for Directed Graphscited by 107
- 2019D-VAE: A Variational Autoencoder for Directed Acyclic Graphscited by 98
- 2023Edge Directionality Improves Learning on Heterophilic Graphscited by 90
- 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
- 2020Rotate to Attend: Convolutional Triplet Attention Modulecited by 75
- 2020Directed Graph Convolutional Networkcited by 73
- 2021Directed Acyclic Graph Neural Networkscited by 70
- 2023CktGNN: Circuit Graph Neural Network for Electronic Design Automationcited by 58
- 2020A Large-Scale Database for Graph Representation Learningcited by 55
- 2023Effectively Modeling Time Series with Simple Discrete State Spacescited by 54
- 2023Transformers Meet Directed Graphscited by 40
- 2022High-Level Synthesis Performance Prediction using GNNs: Benchmarking, Modeling, and Advancingcited by 26
- 2022Transformers over Directed Acyclic Graphscited by 23
- 2022PACE: A Parallelizable Computation Encoder for Directed Acyclic Graphscited by 20
- 2023HoloNets: Spectral Convolutions do extend to Directed Graphscited by 20
- 2023Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classificationcited by 19
- 2021DIGRAC: Digraph Clustering Based on Flow Imbalancecited by 15
- 2021D-HYPR: Harnessing Neighborhood Modeling and Asymmetry Preservation for Digraph Representation Learningcited by 8
- 2024What Are Good Positional Encodings for Directed Graphs?cited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024What Can We Learn from State Space Models for Machine Learning on Graphs?
- 2025Message-Passing State-Space Models: Improving Graph Learning with Modern Sequence Modeling
- 2024State Space Models on Temporal Graphs: A First-Principles Study
- 2024HeteGraph-Mamba: Heterogeneous Graph Learning via Selective State Space Model
- 2026COMBA: Cross Batch Aggregation for Learning Large Graphs with Context Gating State Space Models
- 2025Generating Directed Graphs with Dual Attention and Asymmetric Encoding
- 2025GKNet: Graph Kalman Filtering and Model Inference via Model-based Deep Learning
- 2024GraphEdit: Large Language Models for Graph Structure Learning