Disentangling Shape and Pose for Object-Centric Deep Active Inference Models
Not on the map. Why?
Abstract (arXiv)
Active inference is a first principles approach for understanding the brain in particular, and sentient agents in general, with the single imperative of minimizing free energy. As such, it provides a computational account for modelling artificial intelligent agents, by defining the agent's generative model and inferring the model parameters, actions and hidden state beliefs. However, the exact specification of the generative model and the hidden state space structure is left to the experimenter, whose design choices influence the resulting behaviour of the agent. Recently, deep learning methods have been proposed to learn a hidden state space structure purely from data, alleviating the experimenter from this tedious design task, but resulting in an entangled, non-interpreteable state space. In this paper, we hypothesize that such a learnt, entangled state space does not necessarily yield the best model in terms of free energy, and that enforcing different factors in the state space can yield a lower model complexity. In particular, we consider the problem of 3D object representation, and focus on different instances of the ShapeNet dataset. We propose a model that factorizes object shape, pose and category, while still learning a representation for each factor using a deep neural network. We show that models, with best disentanglement properties, perform best when adopted by an active agent in reaching preferred observations.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 16 Sep 2022.
Builds on
19 of 33 references.
References · 19
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018Disentangling by Factorisingcited by 614
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 240
- 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
- 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
- 2019Are Disentangled Representations Helpful for Abstract Visual Reasoning?cited by 100
7 more
- 2018Taming VAEscited by 85
- 2020Deep active inference agents using Monte-Carlo methodscited by 72
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
- 2017Deep Active Inferencecited by 44
- 2019End-to-End Pixel-Based Deep Active Inference for Body Perception and Actioncited by 24
- 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
- 2021Disentangling What and Where for 3D Object-Centric Representations Through Active Inferencecited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2.
6 papers.
- 2022Disentangled Representation Learningcited by 111
- 2023Symmetry and Complexity in Object-Centric Deep Active Inference Modelscited by 4
- 2023Object-Centric Scene Representations using Active Inferencecited by 2
- 2023Measuring the Effect of Causal Disentanglement on the Adversarial Robustness of Neural Network Modelscited by 0
- 2024Deep hybrid models: infer and plan in a dynamic worldcited by 0
- 2024Dynamic planning in hierarchical active inferencecited by 0
- 2024Dynamic planning in hierarchical active inference18 Feb 2024
- 2024Deep hybrid models: infer and plan in a dynamic world1 Feb 2024
- 2023Measuring the Effect of Causal Disentanglement on the Adversarial Robustness of Neural Network Models21 Aug 2023
- 2023Symmetry and Complexity in Object-Centric Deep Active Inference Models14 Apr 2023
- 2023Object-Centric Scene Representations using Active Inference7 Feb 2023
- 2022Disentangled Representation Learning21 Nov 2022