Rotation, Translation, and Cropping for Zero-Shot Generalization
Not on the map. Why?
Abstract (arXiv)
Deep Reinforcement Learning (DRL) has shown impressive performance on domains with visual inputs, in particular various games. However, the agent is usually trained on a fixed environment, e.g. a fixed number of levels. A growing mass of evidence suggests that these trained models fail to generalize to even slight variations of the environments they were trained on. This paper advances the hypothesis that the lack of generalization is partly due to the input representation, and explores how rotation, cropping and translation could increase generality. We show that a cropped, translated and rotated observation can get better generalization on unseen levels of two-dimensional arcade games from the GVGAI framework. The generality of the agents is evaluated on both human-designed and procedurally generated levels.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 8; 2023: 4; 2024: 4; 2025: 2.
23 papers.
Sort:
By area:
- 2021Collaborating with Humans without Human Datacited by 139
- 2021Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learningcited by 123
- 2021Decoupling Value and Policy for Generalization in Reinforcement Learningcited by 81
- 2023On the Importance of Exploration for Generalization in Reinforcement Learningcited by 30
- 2023The Generalization Gap in Offline Reinforcement Learningcited by 25
- 2023Explore to Generalize in Zero-Shot RLcited by 20
- 2022Learning Task-relevant Representations for Generalization via Characteristic Functions of Reward Sequence Distributionscited by 15
- 2022Path of Destruction: Learning an Iterative Level Generator Using a Small Datasetcited by 14
- 2022Warmth and competence in human-agent cooperationcited by 11
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolutioncited by 9
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
11 more
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generatorscited by 7
- 2022Transfer Dynamics in Emergent Evolutionary Curriculacited by 6
- 2024Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scalecited by 6
- 2022Learning Generalizable Representations for Reinforcement Learning via Adaptive Meta-learner of Behavioral Similaritiescited by 4
- 2023Equivariant Data Augmentation for Generalization in Offline Reinforcement Learningcited by 3
- 2025Provable Zero-Shot Generalization in Offline Reinforcement Learningcited by 3
- 2022Predicting Personas Using Mechanic Frequencies and Game State Tracescited by 2
- 2022ARLO: A Framework for Automated Reinforcement Learningcited by 2
- 2025Adaptive Data Exploitation in Deep Reinforcement Learningcited by 1
- 2021Active Reinforcement Learning over MDPscited by 0
- 2024Do Agents Dream of Electric Sheep?: Improving Generalization in Reinforcement Learning through Generative Learningcited by 0
- 2025Provable Zero-Shot Generalization in Offline Reinforcement Learning11 Mar 2025
- 2025Adaptive Data Exploitation in Deep Reinforcement Learning22 Jan 2025
- 2024Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scale13 Oct 2024
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generators22 Aug 2024
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design25 Jun 2024
- 2024Do Agents Dream of Electric Sheep?: Improving Generalization in Reinforcement Learning through Generative Learning12 Mar 2024
- 2023The Generalization Gap in Offline Reinforcement Learning10 Dec 2023
- 2023Equivariant Data Augmentation for Generalization in Offline Reinforcement Learning14 Sep 2023
- 2023On the Importance of Exploration for Generalization in Reinforcement Learning8 Jun 2023
- 2023Explore to Generalize in Zero-Shot RL5 Jun 2023
- 2022Learning Generalizable Representations for Reinforcement Learning via Adaptive Meta-learner of Behavioral Similarities26 Dec 2022
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolution11 Jun 2022
11 more
- 2022ARLO: A Framework for Automated Reinforcement Learning20 May 2022
- 2022Learning Task-relevant Representations for Generalization via Characteristic Functions of Reward Sequence Distributions20 May 2022
- 2022Predicting Personas Using Mechanic Frequencies and Game State Traces24 Mar 2022
- 2022Transfer Dynamics in Emergent Evolutionary Curricula3 Mar 2022
- 2022Path of Destruction: Learning an Iterative Level Generator Using a Small Dataset21 Feb 2022
- 2022Warmth and competence in human-agent cooperation31 Jan 2022
- 2021Collaborating with Humans without Human Data15 Oct 2021
- 2021Active Reinforcement Learning over MDPs5 Aug 2021
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL30 Jun 2021
- 2021Decoupling Value and Policy for Generalization in Reinforcement Learning20 Feb 2021
- 2021Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning13 Jan 2021
- 2021Collaborating with Humans without Human Datacited by 139
- 2023The Generalization Gap in Offline Reinforcement Learningcited by 25
- 2023Equivariant Data Augmentation for Generalization in Offline Reinforcement Learningcited by 3
- 2025Provable Zero-Shot Generalization in Offline Reinforcement Learningcited by 3
- 2025Provable Zero-Shot Generalization in Offline Reinforcement Learning11 Mar 2025
- 2023The Generalization Gap in Offline Reinforcement Learning10 Dec 2023
- 2023Equivariant Data Augmentation for Generalization in Offline Reinforcement Learning14 Sep 2023
- 2021Collaborating with Humans without Human Data15 Oct 2021
- 2021Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learningcited by 123
- 2021Decoupling Value and Policy for Generalization in Reinforcement Learningcited by 81
- 2023On the Importance of Exploration for Generalization in Reinforcement Learningcited by 30
- 2023Explore to Generalize in Zero-Shot RLcited by 20
- 2022Learning Task-relevant Representations for Generalization via Characteristic Functions of Reward Sequence Distributionscited by 15
- 2022Path of Destruction: Learning an Iterative Level Generator Using a Small Datasetcited by 14
- 2022Warmth and competence in human-agent cooperationcited by 11
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Designcited by 11
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolutioncited by 9
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generatorscited by 7
- 2022Transfer Dynamics in Emergent Evolutionary Curriculacited by 6
12 most cited of 19 All 19 (JSON)
- 2025Adaptive Data Exploitation in Deep Reinforcement Learning22 Jan 2025
- 2024Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scale13 Oct 2024
- 2024PCGRL+: Scaling, Control and Generalization in Reinforcement Learning Level Generators22 Aug 2024
- 2024The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design25 Jun 2024
- 2024Do Agents Dream of Electric Sheep?: Improving Generalization in Reinforcement Learning through Generative Learning12 Mar 2024
- 2023On the Importance of Exploration for Generalization in Reinforcement Learning8 Jun 2023
- 2023Explore to Generalize in Zero-Shot RL5 Jun 2023
- 2022Learning Generalizable Representations for Reinforcement Learning via Adaptive Meta-learner of Behavioral Similarities26 Dec 2022
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolution11 Jun 2022
- 2022ARLO: A Framework for Automated Reinforcement Learning20 May 2022
- 2022Learning Task-relevant Representations for Generalization via Characteristic Functions of Reward Sequence Distributions20 May 2022
- 2022Predicting Personas Using Mechanic Frequencies and Game State Traces24 Mar 2022
12 newest of 19 All 19 (JSON)