Computing Complexity-aware Plans Using Kolmogorov Complexity
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce complexity-aware planning for finite-horizon deterministic finite automata with rewards as outputs, based on Kolmogorov complexity. Kolmogorov complexity is considered since it can detect computational regularities of deterministic optimal policies. We present a planning objective yielding an explicit trade-off between a policy's performance and complexity. It is proven that maximising this objective is non-trivial in the sense that dynamic programming is infeasible. We present two algorithms obtaining low-complexity policies, where the first algorithm obtains a low-complexity optimal policy, and the second algorithm finds a policy maximising performance while maintaining local (stage-wise) complexity constraints. We evaluate the algorithms on a simple navigation task for a mobile robot, where our algorithms yield low-complexity policies that concur with intuition.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 44 references that are in the map. First posted on arXiv 21 Sep 2021.
Builds on
11 of 44 references.
References · 11
- 2015Policy Distillationcited by 414
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
- 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 129
- 2020Learning Discrete State Abstractions With Deep Variational Inferencecited by 10
- 2019A Strongly Asymptotically Optimal Agent in General Environmentscited by 9
- 2015LQG Control with Minimum Directed Information: Semidefinite Programming Approachcited by 4
- 2017Universal Reinforcement Learning Algorithms: Survey and Experimentscited by 4
- 2017Transfer-Entropy-Regularized Markov Decision Processescited by 4
- 2016Minimum-Information LQG Control - Part I: Memoryless Controllerscited by 2
- 2020Learning to Actively Reduce Memory Requirements for Robot Control Taskscited by 2
- 2020Algorithmic Design for Embodied Intelligence in Synthetic Cellscited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1.
2 papers.