mlsanityData to 7 Oct 2026

Disentangling Shape and Pose for Object-Centric Deep Active Inference Models

arXiv 2209.09097 ↗First posted 16 Sep 2022cs.CV cs.AI cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Active inference is a first principles approach for understanding the brain in particular, and sentient agents in general, with the single imperative of minimizing free energy. As such, it provides a computational account for modelling artificial intelligent agents, by defining the agent's generative model and inferring the model parameters, actions and hidden state beliefs. However, the exact specification of the generative model and the hidden state space structure is left to the experimenter, whose design choices influence the resulting behaviour of the agent. Recently, deep learning methods have been proposed to learn a hidden state space structure purely from data, alleviating the experimenter from this tedious design task, but resulting in an entangled, non-interpreteable state space. In this paper, we hypothesize that such a learnt, entangled state space does not necessarily yield the best model in terms of free energy, and that enforcing different factors in the state space can yield a lower model complexity. In particular, we consider the problem of 3D object representation, and focus on different instances of the ShapeNet dataset. We propose a model that factorizes object shape, pose and category, while still learning a representation for each factor using a deep neural network. We show that models, with best disentanglement properties, perform best when adopted by an active agent in reaching preferred observations.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 16 Sep 2022.

Builds on

19 of 33 references.

References · 19

  1. 2013Auto-Encoding Variational Bayescited by 3,980
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2018Disentangling by Factorisingcited by 614
  8. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  9. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 240
  10. 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
  11. 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
  12. 2019Are Disentangled Representations Helpful for Abstract Visual Reasoning?cited by 100
7 more
  1. 2018Taming VAEscited by 85
  2. 2020Deep active inference agents using Monte-Carlo methodscited by 72
  3. 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
  4. 2017Deep Active Inferencecited by 44
  5. 2019End-to-End Pixel-Based Deep Active Inference for Body Perception and Actioncited by 24
  6. 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
  7. 2021Disentangling What and Where for 3D Object-Centric Representations Through Active Inferencecited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 2.

6 papers.