mlsanityData to 7 Oct 2026

Principles of frugal inference and control

arXiv 2406.14427 ↗First posted 20 Jun 2024cs.AI q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

A central challenge for intelligent agents in an uncertain world is striking the right balance between utility maximization and resource use, not only for external movement but also for internal computation. Existing theories of control under uncertainty typically treat inference as cost-free, despite the substantial computational and energetic burden it imposes in both artificial and biological systems. To remedy this problem, we introduce a novel variant of the POMDP framework in which the information acquired through inference is treated as a resource that must be optimized alongside utility. Solving a local linear-Gaussian approximation of the resulting problem reveals three general principles of resource-efficient control. First, when information is costly, inference shifts from a Bayes-optimal (lossless) compression of the past to a lossy regime that strategically leaves some uncertainty unresolved to optimize resource use. Second, relaxing exact Bayesian inference creates a manifold of equivalent solutions, reflecting multiple ways to combine imperfect inference with compensatory control. This flexibility can be used to meet additional objectives or constraints without sacrificing performance on the original task. Third, beyond goal attainment, control can be leveraged to counteract estimation errors and steer the system into regimes where representation costs are lower. We empirically demonstrate that these principles generalize beyond the local linear-Gaussian approximation, enabling the solution of nonlinear control problems such as pole balancing and drone stabilization. Together, these results establish a framework for rational computation that extends existing approaches to information-constrained decision-making and offers normative insight into how brains and machines can achieve effective behavior under tight computational constraints.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 44 references that are in the map. First posted on arXiv 20 Jun 2024.

Builds on

9 of 44 references.

References · 9

  1. 2021People construct simplified mental representations to plancited by 45
  2. 2021Analysis of the Optimization Landscape of Linear Quadratic Gaussian (LQG) Controlcited by 23
  3. 2015Information-Theoretic Bounded Rationalitycited by 21
  4. 2022Optimization-Based Control for Dynamic Legged Robotscited by 21
  5. 2013Reasoning About Beliefs and Actions Under Computational Resource Constraintscited by 18
  6. 2016Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processescited by 7
  7. 2022A Unified Theory of Dual-Process Controlcited by 3
  8. 2020Rationally Inattentive Path-Planning via RRT*cited by 2
  9. 2014Optimal Population Codes for Control and Estimationcited by 1

Built on by

Not cited yet.