Group Equivariant Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In Reinforcement Learning (RL), Convolutional Neural Networks(CNNs) have been successfully applied as function approximators in Deep Q-Learning algorithms, which seek to learn action-value functions and policies in various environments. However, to date, there has been little work on the learning of symmetry-transformation equivariant representations of the input environment state. In this paper, we propose the use of Equivariant CNNs to train RL agents and study their inductive bias for transformation equivariant Q-value approximation. We demonstrate that equivariant architectures can dramatically enhance the performance and sample efficiency of RL agents in a highly symmetric environment while requiring fewer parameters. Additionally, we show that they are robust to changes in the environment caused by affine transformations.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 7; 2024: 4; 2025: 3; 2026: 1.
22 papers.
Sort:
By area:
- 2022Equivariance with Learned Canonicalization Functionscited by 106
- 2023Equivariant Adaptation of Large Pretrained Modelscited by 40
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetrycited by 32
- 2021Self-Interpretable Model with TransformationEquivariant Interpretationcited by 21
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Reviewcited by 18
- 2024Equivariant Reinforcement Learning under Partial Observabilitycited by 17
- 2022Equivariant Networks for Zero-Shot Coordinationcited by 16
- 2023On Robot Grasp Learning Using Equivariant Modelscited by 12
- 2023Sample Efficient Reinforcement Learning in Mixed Systems through Augmented Samples and Its Applications to Queueing Networkscited by 9
- 2024Approximate Equivariance in Reinforcement Learningcited by 9
- 2024Improved Canonicalization for Model Agnostic Equivariancecited by 7
- 2022Integrating Symmetry into Differentiable Planning with Steerable Convolutionscited by 6
10 more
- 2023E(2)-Equivariant Graph Planning for Navigationcited by 6
- 2024Equivariant Offline Reinforcement Learningcited by 5
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extensioncited by 4
- 20253D Equivariant Visuomotor Policy Learning via Spherical Projectioncited by 4
- 2022ReF -- Rotation Equivariant Features for Local Feature Matchingcited by 2
- 2023Can Euclidean Symmetry be Leveraged in Reinforcement Learning and Planning?cited by 1
- 2025Symmetries-enhanced Multi-Agent Reinforcement Learningcited by 1
- 2025Learning Abstract World Models with a Group-Structured Latent Spacecited by 1
- 2023Learning Geometric Representations of Objects via Interactioncited by 0
- 2026SymVD: Symmetric Vision Language Action Distillation for Robot Manipulationcited by 0
- 2026SymVD: Symmetric Vision Language Action Distillation for Robot Manipulation30 Aug 2026
- 2025Learning Abstract World Models with a Group-Structured Latent Space2 Jun 2025
- 20253D Equivariant Visuomotor Policy Learning via Spherical Projection22 May 2025
- 2025Symmetries-enhanced Multi-Agent Reinforcement Learning2 Jan 2025
- 2024Approximate Equivariance in Reinforcement Learning6 Nov 2024
- 2024Equivariant Reinforcement Learning under Partial Observability26 Aug 2024
- 2024Equivariant Offline Reinforcement Learning20 Jun 2024
- 2024Improved Canonicalization for Model Agnostic Equivariance23 May 2024
- 2023Equivariant Adaptation of Large Pretrained Models2 Oct 2023
- 2023E(2)-Equivariant Graph Planning for Navigation22 Sep 2023
- 2023Learning Geometric Representations of Objects via Interaction11 Sep 2023
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extension6 Sep 2023
10 more
- 2023Can Euclidean Symmetry be Leveraged in Reinforcement Learning and Planning?17 Jul 2023
- 2023On Robot Grasp Learning Using Equivariant Models10 Jun 2023
- 2023Sample Efficient Reinforcement Learning in Mixed Systems through Augmented Samples and Its Applications to Queueing Networks25 May 2023
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry16 Nov 2022
- 2022Equivariance with Learned Canonicalization Functions11 Nov 2022
- 2022Equivariant Networks for Zero-Shot Coordination21 Oct 2022
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Review27 Aug 2022
- 2022Integrating Symmetry into Differentiable Planning with Steerable Convolutions8 Jun 2022
- 2022ReF -- Rotation Equivariant Features for Local Feature Matching10 Mar 2022
- 2021Self-Interpretable Model with TransformationEquivariant Interpretation9 Nov 2021
- 2024Equivariant Offline Reinforcement Learningcited by 5
- 2024Equivariant Offline Reinforcement Learning20 Jun 2024
- 2022Equivariance with Learned Canonicalization Functionscited by 106
- 2023Equivariant Adaptation of Large Pretrained Modelscited by 40
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetrycited by 32
- 2021Self-Interpretable Model with TransformationEquivariant Interpretationcited by 21
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Reviewcited by 18
- 2024Equivariant Reinforcement Learning under Partial Observabilitycited by 17
- 2022Equivariant Networks for Zero-Shot Coordinationcited by 16
- 2023On Robot Grasp Learning Using Equivariant Modelscited by 12
- 2023Sample Efficient Reinforcement Learning in Mixed Systems through Augmented Samples and Its Applications to Queueing Networkscited by 9
- 2024Approximate Equivariance in Reinforcement Learningcited by 9
- 2024Improved Canonicalization for Model Agnostic Equivariancecited by 7
- 2022Integrating Symmetry into Differentiable Planning with Steerable Convolutionscited by 6
12 most cited of 18 All 18 (JSON)
- 2025Symmetries-enhanced Multi-Agent Reinforcement Learning2 Jan 2025
- 2024Approximate Equivariance in Reinforcement Learning6 Nov 2024
- 2024Equivariant Reinforcement Learning under Partial Observability26 Aug 2024
- 2024Improved Canonicalization for Model Agnostic Equivariance23 May 2024
- 2023Equivariant Adaptation of Large Pretrained Models2 Oct 2023
- 2023E(2)-Equivariant Graph Planning for Navigation22 Sep 2023
- 2023Learning Geometric Representations of Objects via Interaction11 Sep 2023
- 2023Addressing imperfect symmetry: A novel symmetry-learning actor-critic extension6 Sep 2023
- 2023Can Euclidean Symmetry be Leveraged in Reinforcement Learning and Planning?17 Jul 2023
- 2023On Robot Grasp Learning Using Equivariant Models10 Jun 2023
- 2023Sample Efficient Reinforcement Learning in Mixed Systems through Augmented Samples and Its Applications to Queueing Networks25 May 2023
- 2022The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry16 Nov 2022
12 newest of 18 All 18 (JSON)