Equivariant Representation Learning via Class-Pose Decomposition
Not on the map. Why?
Abstract (arXiv)
We introduce a general method for learning representations that are equivariant to symmetries of data. Our central idea is to decompose the latent space into an invariant factor and the symmetry group itself. The components semantically correspond to intrinsic data classes and poses respectively. The learner is trained on a loss encouraging equivariance based on supervision from relative symmetry information. The approach is motivated by theoretical results from group theory and guarantees representations that are lossless, interpretable and disentangled. We provide an empirical investigation via experiments involving datasets with a variety of symmetries. Results show that our representations capture the geometry of data and outperform other equivariant representation learning frameworks.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 7 Jul 2022.
Builds on
31 of 41 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2018World Modelscited by 1,513
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
19 more
- 2018Spherical CNNscited by 456
- 2018Towards a Definition of Disentangled Representationscited by 296
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 239
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
- 2019Contrastive Learning of Structured World Modelscited by 209
- 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
- 2020On Learning Sets of Symmetric Elementscited by 98
- 2018Explorations in Homeomorphic Variational Auto-Encodingcited by 65
- 2020Plannable Approximations to MDP Homomorphisms: Equivariance under Actionscited by 61
- 2022Learning Symmetric Embeddings for Equivariant World Modelscited by 54
- 2020Equivariant Neural Renderingcited by 48
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 39
- 2017Interpretable Transformations with Encoder-Decoder Networkscited by 34
- 2022Symmetry-Based Representations for Artificial and Biological General Intelligencecited by 26
- 2021Towards Building A Group-based Unsupervised Representation Disentanglement Frameworkcited by 22
- 2020Learning Group Structure and Disentangled Representations of Dynamical Environmentscited by 13
- 2020Quantifying and Learning Linear Symmetry-Based Disentanglementcited by 9
- 2018Efficient conversion from rotating matrix to rotation axis and angle by extending Rodrigues' formulacited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 1; 2025: 2; 2026: 3.
17 papers.
Sort:
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2023Self-supervised learning of Split Invariant Equivariant representationscited by 44
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetrycited by 33
- 2023Latent Space Symmetry Discoverycited by 29
- 2023Steerers: A framework for rotation equivariant keypoint descriptorscited by 21
- 2022Back to the Manifold: Recovering from Out-of-Distribution Statescited by 20
- 2023A General Theory of Correct, Incorrect, and Extrinsic Equivariancecited by 19
- 2023Topological Obstructions and How to Avoid Themcited by 4
- 2023Algebras of actions in an agent's representations of the worldcited by 2
- 2024CFASL: Composite Factor-Aligned Symmetry Learning for Disentanglement in Variational AutoEncodercited by 2
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalizationcited by 1
- 2026Soft Equivariance Regularization for Invariant Self-Supervised Learningcited by 1
5 more
- 2023Equivariant Representation Learning in the Presence of Stabilizerscited by 0
- 2023Learning Geometric Representations of Objects via Interactioncited by 0
- 2025EquiCaps: Predictor-Free Pose-Aware Pre-Trained Capsule Networkscited by 0
- 2026Group-invariant Coresets for Data-efficient Active Learningcited by 0
- 2026Capturing Cardiac Cyclicity through Phase-Equivariant Self-Supervised Learningcited by 0
- 2026Capturing Cardiac Cyclicity through Phase-Equivariant Self-Supervised Learning21 Aug 2026
- 2026Group-invariant Coresets for Data-efficient Active Learning1 Jul 2026
- 2026Soft Equivariance Regularization for Invariant Self-Supervised Learning4 Mar 2026
- 2025EquiCaps: Predictor-Free Pose-Aware Pre-Trained Capsule Networks11 Jun 2025
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2024CFASL: Composite Factor-Aligned Symmetry Learning for Disentanglement in Variational AutoEncoder17 Jan 2024
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023Steerers: A framework for rotation equivariant keypoint descriptors4 Dec 2023
- 2023Algebras of actions in an agent's representations of the world2 Oct 2023
- 2023Latent Space Symmetry Discovery29 Sep 2023
- 2023Learning Geometric Representations of Objects via Interaction11 Sep 2023
- 2023A Cookbook of Self-Supervised Learning24 Apr 2023
5 more
- 2023A General Theory of Correct, Incorrect, and Extrinsic Equivariance8 Mar 2023
- 2023Self-supervised learning of Split Invariant Equivariant representations14 Feb 2023
- 2023Equivariant Representation Learning in the Presence of Stabilizers12 Jan 2023
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry16 Nov 2022
- 2022Back to the Manifold: Recovering from Out-of-Distribution States18 Jul 2022
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2023Self-supervised learning of Split Invariant Equivariant representationscited by 44
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetrycited by 33
- 2023Latent Space Symmetry Discoverycited by 29
- 2023Steerers: A framework for rotation equivariant keypoint descriptorscited by 21
- 2022Back to the Manifold: Recovering from Out-of-Distribution Statescited by 20
- 2023A General Theory of Correct, Incorrect, and Extrinsic Equivariancecited by 19
- 2023Topological Obstructions and How to Avoid Themcited by 4
- 2023Algebras of actions in an agent's representations of the worldcited by 2
- 2024CFASL: Composite Factor-Aligned Symmetry Learning for Disentanglement in Variational AutoEncodercited by 2
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalizationcited by 1
- 2026Soft Equivariance Regularization for Invariant Self-Supervised Learningcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Capturing Cardiac Cyclicity through Phase-Equivariant Self-Supervised Learning21 Aug 2026
- 2026Group-invariant Coresets for Data-efficient Active Learning1 Jul 2026
- 2026Soft Equivariance Regularization for Invariant Self-Supervised Learning4 Mar 2026
- 2025EquiCaps: Predictor-Free Pose-Aware Pre-Trained Capsule Networks11 Jun 2025
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2024CFASL: Composite Factor-Aligned Symmetry Learning for Disentanglement in Variational AutoEncoder17 Jan 2024
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023Steerers: A framework for rotation equivariant keypoint descriptors4 Dec 2023
- 2023Algebras of actions in an agent's representations of the world2 Oct 2023
- 2023Latent Space Symmetry Discovery29 Sep 2023
- 2023Learning Geometric Representations of Objects via Interaction11 Sep 2023
- 2023A Cookbook of Self-Supervised Learning24 Apr 2023
12 newest of 17 All 17 (JSON)