mlsanityData to 14 Oct 2026

Stochastic Reset Pathfinding: Path-Level Regret for Cascading Bandits over Graph Paths

arXiv 2607.15440 ↗First posted 16 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce Stochastic Reset Pathfinding (SRP), an episodic learning problem on a known directed graph with unknown stationary edge success probabilities. In each episode, the agent commits to a source-to-goal path, and any edge failure during execution resets it to the source. SRP captures settings such as entanglement distribution in quantum repeater networks, payment routing on the Lightning Network, and delivery in unreliable mesh networks. We show that the global-reset structure makes the optimal policy open-loop, placing SRP within the combinatorial cascading bandit (CCB) framework. We propose a Log-Dijkstra meta-algorithm with UCB (PathUCB) and Thompson Sampling (PathTS) instantiations. Our main technical result is a path-level regret bound for PathUCB that decomposes regret over suboptimal paths via a per-path complexity C(pi) combining each edge's prefix and suffix reliability. The bound is complementary to the edge-level CCB bound and more informative on structured graphs with polynomially many source-to-goal paths. Experiments on quantum-network, layered-DAG, grid-world, and Erdos-Renyi domains support the theory and show that PathTS typically achieves the best empirical performance among the algorithms tested. We then exhibit an adversarial instance on which PathTS fails to converge, consistent with a known exponential obstruction for combinatorial Thompson Sampling on multiplicative-reward problems. We recommend PathTS as the practical default while cautioning that adversarial instances exist.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

11 of 32 references.

References · 11

  1. 2017A Tutorial on Thompson Samplingcited by 433
  2. 2018Thompson Sampling for Combinatorial Semi-Banditscited by 78
  3. 2015Cascading Bandits: Learning to Rank in the Cascade Modelcited by 77
  4. 2020Near-optimal Regret Bounds for Stochastic Shortest Pathcited by 50
  5. 2015Combinatorial Cascading Banditscited by 40
  6. 2022Minimax Regret for Cascading Banditscited by 10
  7. 2024Cascading Reinforcement Learningcited by 4
  8. 2018Learning to Route Efficiently with End-to-End Feedback: The Value of Networked Structurecited by 3
  9. 2021Optimally Reliable & Cheap Payment Flows on the Lightning Networkcited by 3
  10. 2025Stochastic Shortest Path with Sparse Adversarial Costscited by 1
  11. 2026Sample Complexity Bounds for Stochastic Shortest Path with a Generative Modelcited by 1

Built on by

Not cited yet.