Faster Algorithms for Computing the Stationary Distribution, Simulating Random Walks, and More
Not on the map. Why?
Abstract (arXiv)
In this paper, we provide faster algorithms for computing various fundamental quantities associated with random walks on a directed graph, including the stationary distribution, personalized PageRank vectors, hitting times, and escape probabilities. In particular, on a directed graph with n vertices and m edges, we show how to compute each quantity in time tildeO(m3/4n+mn2/3), where the tildeO notation suppresses polylogarithmic factors in n, the desired accuracy, and the appropriate condition number (i.e. the mixing time or restart probability). Our result improves upon the previous fastest running times for these problems; previous results either invoke a general purpose linear system solver on a n× n matrix with m non-zero entries, or depend polynomially on the desired error or natural condition number associated with the problem (i.e. the mixing time or restart probability). For sparse graphs, we obtain a running time of tildeO(n7/4), breaking the O(n2) barrier of the best running time one could hope to achieve using fast matrix multiplication. We achieve our result by providing a similar running time improvement for solving directed Laplacian systems, a natural directed or asymmetric analog of the well studied symmetric or undirected Laplacian systems. We show how to solve such systems in time tildeO(m3/4n+mn2/3), and efficiently reduce a broad range of problems to solving tildeO(1) directed Laplacian systems on Eulerian graphs. We hope these results and our analysis open the door for further study into directed spectral graph theory.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Aug 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 1.
4 papers.
- 2021Towards Tight Bounds on the Sample Complexity of Average-reward MDPscited by 33
- 2022Stochastic first-order methods for average-reward Markov decision processescited by 32
- 2022Cheeger Inequalities for Directed Graphs and Hypergraphs Using Reweighted Eigenvaluescited by 3
- 2024ULTRA-MC: A Unified Approach to Learning Mixtures of Markov Chains via Hitting Timescited by 2
- 2024ULTRA-MC: A Unified Approach to Learning Mixtures of Markov Chains via Hitting Times23 May 2024
- 2022Cheeger Inequalities for Directed Graphs and Hypergraphs Using Reweighted Eigenvalues17 Nov 2022
- 2022Stochastic first-order methods for average-reward Markov decision processes11 May 2022
- 2021Towards Tight Bounds on the Sample Complexity of Average-reward MDPs13 Jun 2021