On Value Iteration Convergence in Connected MDPs
Not on the map. Why?
Abstract (arXiv)
This paper establishes that an MDP with a unique optimal policy and ergodic associated transition matrix ensures the convergence of various versions of the Value Iteration algorithm at a geometric rate that exceeds the discount factor γ for both discounted and average-reward criteria.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 0 of its 3 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
0 of 3 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.