Symmetry and Complexity in Object-Centric Deep Active Inference Models
Not on the map. Why?
Abstract (arXiv)
Humans perceive and interact with hundreds of objects every day. In doing so, they need to employ mental models of these objects and often exploit symmetries in the object's shape and appearance in order to learn generalizable and transferable skills. Active inference is a first principles approach to understanding and modeling sentient agents. It states that agents entertain a generative model of their environment, and learn and act by minimizing an upper bound on their surprisal, i.e. their Free Energy. The Free Energy decomposes into an accuracy and complexity term, meaning that agents favor the least complex model, that can accurately explain their sensory observations. In this paper, we investigate how inherent symmetries of particular objects also emerge as symmetries in the latent state space of the generative model learnt under deep active inference. In particular, we focus on object-centric representations, which are trained from pixels to predict novel object views as the agent moves its viewpoint. First, we investigate the relation between model complexity and symmetry exploitation in the state space. Second, we do a principal component analysis to demonstrate how the model encodes the principal axis of symmetry of the object in the latent space. Finally, we also demonstrate how more symmetrical representations can be exploited for better generalization in the context of manipulation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 10 of its 31 references that are in the map. First posted on arXiv 14 Apr 2023.
Builds on
10 of 31 references.
References · 10
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2019Are Disentangled Representations Helpful for Abstract Visual Reasoning?cited by 100
- 2018Explorations in Homeomorphic Variational Auto-Encodingcited by 65
- 2018Improving Generalization for Abstract Reasoning Tasks Using Disentangled Feature Representationscited by 28
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
- 2022Disentangling Shape and Pose for Object-Centric Deep Active Inference Modelscited by 6
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.
4 papers.
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metricscited by 2
- 2026Object-Centric World Models Meet Monte Carlo Tree Searchcited by 1
- 2023Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Uglycited by 0
- 2024Dynamic planning in hierarchical active inferencecited by 0
- 2026Object-Centric World Models Meet Monte Carlo Tree Search10 Jan 2026
- 2024Dynamic planning in hierarchical active inference18 Feb 2024
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics21 Sep 2023
- 2023Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Ugly30 Aug 2023