mlsanityData to 7 Oct 2026

Computing Complexity-aware Plans Using Kolmogorov Complexity

arXiv 2109.10303 ↗First posted 21 Sep 2021eess.SY cs.AI cs.SYcited by 2

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce complexity-aware planning for finite-horizon deterministic finite automata with rewards as outputs, based on Kolmogorov complexity. Kolmogorov complexity is considered since it can detect computational regularities of deterministic optimal policies. We present a planning objective yielding an explicit trade-off between a policy's performance and complexity. It is proven that maximising this objective is non-trivial in the sense that dynamic programming is infeasible. We present two algorithms obtaining low-complexity policies, where the first algorithm obtains a low-complexity optimal policy, and the second algorithm finds a policy maximising performance while maintaining local (stage-wise) complexity constraints. We evaluate the algorithms on a simple navigation task for a mobile robot, where our algorithms yield low-complexity policies that concur with intuition.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 44 references that are in the map. First posted on arXiv 21 Sep 2021.

Builds on

11 of 44 references.

References · 11

  1. 2015Policy Distillationcited by 414
  2. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
  3. 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 129
  4. 2020Learning Discrete State Abstractions With Deep Variational Inferencecited by 10
  5. 2019A Strongly Asymptotically Optimal Agent in General Environmentscited by 9
  6. 2015LQG Control with Minimum Directed Information: Semidefinite Programming Approachcited by 4
  7. 2017Universal Reinforcement Learning Algorithms: Survey and Experimentscited by 4
  8. 2017Transfer-Entropy-Regularized Markov Decision Processescited by 4
  9. 2016Minimum-Information LQG Control - Part I: Memoryless Controllerscited by 2
  10. 2020Learning to Actively Reduce Memory Requirements for Robot Control Taskscited by 2
  11. 2020Algorithmic Design for Embodied Intelligence in Synthetic Cellscited by 1

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 1.

2 papers.