# Faster Algorithms for Computing the Stationary Distribution, Simulating Random Walks, and More

arXiv: https://arxiv.org/abs/1608.03270 · HTML: https://mlsanity.com/paper/1608.03270/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Aug 2016.

## Built on by (most cited first, 4 of 4)

- [Towards Tight Bounds on the Sample Complexity of Average-reward MDPs](https://mlsanity.com/paper/2106.07046/) (2021)
- [Stochastic first-order methods for average-reward Markov decision processes](https://mlsanity.com/paper/2205.05800/) (2022)
- [Cheeger Inequalities for Directed Graphs and Hypergraphs Using Reweighted Eigenvalues](https://mlsanity.com/paper/2211.09776/) (2022)
- [ULTRA-MC: A Unified Approach to Learning Mixtures of Markov Chains via Hitting Times](https://mlsanity.com/paper/2405.15094/) (2024)

## Abstract (arXiv)

In this paper, we provide faster algorithms for computing various fundamental quantities associated with random walks on a directed graph, including the stationary distribution, personalized PageRank vectors, hitting times, and escape probabilities. In particular, on a directed graph with n vertices and m edges, we show how to compute each quantity in time tildeO(m3/4n+mn2/3), where the tildeO notation suppresses polylogarithmic factors in n, the desired accuracy, and the appropriate condition number (i.e. the mixing time or restart probability). Our result improves upon the previous fastest running times for these problems; previous results either invoke a general purpose linear system solver on a n× n matrix with m non-zero entries, or depend polynomially on the desired error or natural condition number associated with the problem (i.e. the mixing time or restart probability). For sparse graphs, we obtain a running time of tildeO(n7/4), breaking the O(n2) barrier of the best running time one could hope to achieve using fast matrix multiplication. We achieve our result by providing a similar running time improvement for solving directed Laplacian systems, a natural directed or asymmetric analog of the well studied symmetric or undirected Laplacian systems. We show how to solve such systems in time tildeO(m3/4n+mn2/3), and efficiently reduce a broad range of problems to solving tildeO(1) directed Laplacian systems on Eulerian graphs. We hope these results and our analysis open the door for further study into directed spectral graph theory.