Symmetry-Based Disentangled Representation Learning requires Interaction with Environments
Not on the map. Why?
Abstract (arXiv)
Finding a generally accepted formal definition of a disentangled representation in the context of an agent behaving in an environment is an important challenge towards the construction of data-efficient autonomous agents. Higgins et al. recently proposed Symmetry-Based Disentangled Representation Learning, a definition based on a characterization of symmetries in the environment using group theory. We build on their work and make observations, theoretical and empirical, that lead us to argue that Symmetry-Based Disentangled Representation Learning cannot only be based on static observations: agents should interact with the environment to discover its symmetries. Our experiments can be reproduced in Colab and the code is available on GitHub.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 12; 2023: 7; 2024: 2; 2025: 2; 2026: 5.
35 papers.
Sort:
By area:
- 2022Disentangled Representation Learningcited by 111
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2023Latent Space Symmetry Discoverycited by 29
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2021Koopman Q-learning: Offline Reinforcement Learning via Symmetries of Dynamicscited by 27
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2022Continuous MDP Homomorphisms and Homomorphic Policy Gradientcited by 24
- 2021Towards Building A Group-based Unsupervised Representation Disentanglement Frameworkcited by 22
- 2022Toward Compositional Generalization in Object-Oriented World Modelingcited by 22
- 2022Homomorphism Autoencoder -- Learning Group Structured Representations from Observed Transitionscited by 18
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Reviewcited by 18
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operatorscited by 14
23 more
- 2023Policy Gradient Methods in the Presence of Symmetries and State Abstractionscited by 8
- 2021Hamiltonian latent operators for content and motion disentanglement in image sequencescited by 5
- 2023Topological Obstructions and How to Avoid Themcited by 4
- 2024SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learningcited by 3
- 2025What Drives Compositional Generalization in Visual Generative Models? The Importance of Continuous Training Objectivescited by 3
- 2023Enriching Disentanglement: From Logical Definitions to Quantitative Metricscited by 2
- 2023Algebras of actions in an agent's representations of the worldcited by 2
- 2021VECA : A Toolkit for Building Virtual Environments to Train and Test Human-like Agentscited by 1
- 2022Equivariant Disentangled Transformation for Domain Generalization under Combination Shiftcited by 1
- 2024Measuring Orthogonality in Representations of Generative Modelscited by 1
- 2026Groupoid-Based Internal State Representations for Reinforcement Learning with Local Symmetriescited by 1
- 2022Transformation Coding: Simple Objectives for Equivariant Representationscited by 0
- 2022On a Built-in Conflict between Deep Learning and Systematic Generalizationcited by 0
- 2022Learning Parsimonious Dynamics for Generalization in Reinforcement Learningcited by 0
- 2022A Short Survey of Systematic Generalizationcited by 0
- 2022Symmetry Detection in Trajectory Data for More Meaningful Reinforcement Learning Representationscited by 0
- 2023Switchable Lightweight Anti-symmetric Processing (SLAP) with CNN Outspeeds Data Augmentation by Smaller Sample -- Application in Gomoku Reinforcement Learningcited by 0
- 2023Equivariant Representation Learning in the Presence of Stabilizerscited by 0
- 2025Developmental Symmetry-Loss: A Free-Energy Perspective on Brain-Inspired Invariance Learningcited by 0
- 2026Disentangled Representation Learning through Unsupervised Symmetry Group Discoverycited by 0
- 2026Investigating Permutation-Invariant Discrete Representation Learning for Spatially Aligned Imagescited by 0
- 2026Disentanglement Beyond Generative Models with Riemannian ICAcited by 0
- 2026Categorical Internalisation of Environmental Groupoids for Generalisable POMDP Solvingcited by 0
- 2026Categorical Internalisation of Environmental Groupoids for Generalisable POMDP Solving23 Sep 2026
- 2026Groupoid-Based Internal State Representations for Reinforcement Learning with Local Symmetries11 Sep 2026
- 2026Disentanglement Beyond Generative Models with Riemannian ICA21 May 2026
- 2026Investigating Permutation-Invariant Discrete Representation Learning for Spatially Aligned Images2 Apr 2026
- 2026Disentangled Representation Learning through Unsupervised Symmetry Group Discovery12 Mar 2026
- 2025Developmental Symmetry-Loss: A Free-Energy Perspective on Brain-Inspired Invariance Learning4 Dec 2025
- 2025What Drives Compositional Generalization in Visual Generative Models? The Importance of Continuous Training Objectives3 Oct 2025
- 2024Measuring Orthogonality in Representations of Generative Models4 Jul 2024
- 2024SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learning21 Jun 2024
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023Algebras of actions in an agent's representations of the world2 Oct 2023
- 2023Latent Space Symmetry Discovery29 Sep 2023
23 more
- 2023Enriching Disentanglement: From Logical Definitions to Quantitative Metrics19 May 2023
- 2023Policy Gradient Methods in the Presence of Symmetries and State Abstractions9 May 2023
- 2023Equivariant Representation Learning in the Presence of Stabilizers12 Jan 2023
- 2023Switchable Lightweight Anti-symmetric Processing (SLAP) with CNN Outspeeds Data Augmentation by Smaller Sample -- Application in Gomoku Reinforcement Learning11 Jan 2023
- 2022Symmetry Detection in Trajectory Data for More Meaningful Reinforcement Learning Representations29 Nov 2022
- 2022A Short Survey of Systematic Generalization22 Nov 2022
- 2022Disentangled Representation Learning21 Nov 2022
- 2022Learning Parsimonious Dynamics for Generalization in Reinforcement Learning29 Sep 2022
- 2022Continuous MDP Homomorphisms and Homomorphic Policy Gradient15 Sep 2022
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Review27 Aug 2022
- 2022On a Built-in Conflict between Deep Learning and Systematic Generalization24 Aug 2022
- 2022Equivariant Disentangled Transformation for Domain Generalization under Combination Shift3 Aug 2022
- 2022Homomorphism Autoencoder -- Learning Group Structured Representations from Observed Transitions25 Jul 2022
- 2022Toward Compositional Generalization in Object-Oriented World Modeling28 Apr 2022
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligence17 Mar 2022
- 2022Transformation Coding: Simple Objectives for Equivariant Representations19 Feb 2022
- 2021Hamiltonian latent operators for content and motion disentanglement in image sequences2 Dec 2021
- 2021Koopman Q-learning: Offline Reinforcement Learning via Symmetries of Dynamics2 Nov 2021
- 2021Learning Disentangled Representations in the Imaging Domain26 Aug 2021
- 2021Commutative Lie Group VAE for Disentanglement Learning7 Jun 2021
- 2021VECA : A Toolkit for Building Virtual Environments to Train and Test Human-like Agents3 May 2021
- 2021Towards Building A Group-based Unsupervised Representation Disentanglement Framework20 Feb 2021
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operators10 Feb 2021
- 2022Disentangled Representation Learningcited by 111
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2023Latent Space Symmetry Discoverycited by 29
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2022Continuous MDP Homomorphisms and Homomorphic Policy Gradientcited by 24
- 2021Towards Building A Group-based Unsupervised Representation Disentanglement Frameworkcited by 22
- 2022Homomorphism Autoencoder -- Learning Group Structured Representations from Observed Transitionscited by 18
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Reviewcited by 18
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operatorscited by 14
- 2023Policy Gradient Methods in the Presence of Symmetries and State Abstractionscited by 8
- 2021Hamiltonian latent operators for content and motion disentanglement in image sequencescited by 5
12 most cited of 33 All 33 (JSON)
- 2026Categorical Internalisation of Environmental Groupoids for Generalisable POMDP Solving23 Sep 2026
- 2026Groupoid-Based Internal State Representations for Reinforcement Learning with Local Symmetries11 Sep 2026
- 2026Disentanglement Beyond Generative Models with Riemannian ICA21 May 2026
- 2026Investigating Permutation-Invariant Discrete Representation Learning for Spatially Aligned Images2 Apr 2026
- 2026Disentangled Representation Learning through Unsupervised Symmetry Group Discovery12 Mar 2026
- 2025Developmental Symmetry-Loss: A Free-Energy Perspective on Brain-Inspired Invariance Learning4 Dec 2025
- 2025What Drives Compositional Generalization in Visual Generative Models? The Importance of Continuous Training Objectives3 Oct 2025
- 2024Measuring Orthogonality in Representations of Generative Models4 Jul 2024
- 2024SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learning21 Jun 2024
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023Algebras of actions in an agent's representations of the world2 Oct 2023
- 2023Latent Space Symmetry Discovery29 Sep 2023
12 newest of 33 All 33 (JSON)