Meta Reinforcement Learning with Latent Variable Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
Learning from small data sets is critical in many practical applications where data collection is time consuming or expensive, e.g., robotics, animal experiments or drug design. Meta learning is one way to increase the data efficiency of learning algorithms by generalizing learned concepts from a set of training tasks to unseen, but related, tasks. Often, this relationship between tasks is hard coded or relies in some other way on human expertise. In this paper, we frame meta learning as a hierarchical latent variable model and infer the relationship between tasks automatically from data. We apply our framework in a model-based reinforcement learning setting and show that our meta-learning model effectively generalizes to novel tasks by identifying how new tasks relate to prior ones from minimal data. This results in up to a 60% reduction in the average interaction time needed to solve tasks compared to strong baselines.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 2; 2020: 1; 2021: 18; 2022: 6; 2023: 6; 2024: 3; 2025: 6; 2026: 2.
44 papers.
Sort:
By area:
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2020Offline Meta-Reinforcement Learning with Advantage Weightingcited by 92
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 55
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environmentscited by 33
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 32
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Rewardcited by 26
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2021Model-based Meta Reinforcement Learning using Graph Structured Surrogate Modelscited by 16
- 2021CoMPS: Continual Meta Policy Searchcited by 15
- 2022A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learningcited by 15
32 more
- 2025Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planningcited by 12
- 2021PerSim: Data-Efficient Offline Reinforcement Learning with Heterogeneous Agents via Personalized Simulatorscited by 10
- 2022Continual Vision-based Reinforcement Learning with Group Symmetriescited by 10
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learningcited by 8
- 2022Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarioscited by 8
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processescited by 8
- 2021MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerancecited by 7
- 2021Explore the Context: Optimal Data Collection for Context-Conditional Dynamics Modelscited by 6
- 2023Data-Efficient Task Generalization via Probabilistic Model-based Meta Reinforcement Learningcited by 6
- 2025Linear Mixture Distributionally Robust Markov Decision Processescited by 5
- 2021Robust and Adaptive Temporal-Difference Learning Using An Ensemble of Gaussian Processescited by 4
- 2021Bayesian Meta-Learning Through Variational Gaussian Processescited by 3
- 2022A model-based approach to meta-Reinforcement Learning: Transformers and tree searchcited by 3
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfercited by 3
- 2025PrivilegedDreamer: Explicit Imagination of Privileged Information for Rapid Adaptation of Learned Policiescited by 3
- 2021MetaKernel: Learning Variational Random Features with Limited Labelscited by 2
- 2023Learning How to Infer Partial MDPs for In-Context Adaptation and Explorationcited by 2
- 2024Systems with Switching Causal Relations: A Meta-Causal Perspectivecited by 2
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processescited by 2
- 2021Adaptive Adversarial Training for Meta Reinforcement Learningcited by 1
- 2021Learning Robust Controllers Via Probabilistic Model-Based Policy Searchcited by 1
- 2023On Task-Relevant Loss Functions in Meta-Reinforcement Learning and Online LQRcited by 1
- 2024Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspectivecited by 1
- 2021Meta-Reinforcement Learning for Adaptive Motor Control in Changing Robot Dynamics and Environmentscited by 0
- 2021Robustifying Reinforcement Learning Policies with L1 Adaptive Controlcited by 0
- 2021Learning to Transfer: A Foliated Theorycited by 0
- 2022Online No-regret Model-Based Meta RL for Personalized Navigationcited by 0
- 2023Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptationcited by 0
- 2025Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimizationcited by 0
- 2025Improving Forecasts of Suicide Attempts for Patients with Little Datacited by 0
- 2026MetaKoopman: Bayesian Meta-Learning of Koopman Operators for Modeling Structured Dynamics under Distribution Shiftscited by 0
- 2026Hierarchical Belief Modeling for Zero-Shot Opponent Adaptation in Partially Observable Multi-Agent Navigationcited by 0
- 2026Hierarchical Belief Modeling for Zero-Shot Opponent Adaptation in Partially Observable Multi-Agent Navigation11 Sep 2026
- 2026MetaKoopman: Bayesian Meta-Learning of Koopman Operators for Modeling Structured Dynamics under Distribution Shifts28 Jul 2026
- 2025Improving Forecasts of Suicide Attempts for Patients with Little Data22 Nov 2025
- 2025Linear Mixture Distributionally Robust Markov Decision Processes23 May 2025
- 2025Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimization19 May 2025
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processes14 Apr 2025
- 2025Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planning26 Feb 2025
- 2025PrivilegedDreamer: Explicit Imagination of Privileged Information for Rapid Adaptation of Learned Policies17 Feb 2025
- 2024Systems with Switching Causal Relations: A Meta-Causal Perspective16 Oct 2024
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfer6 May 2024
- 2024Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspective24 Apr 2024
- 2023On Task-Relevant Loss Functions in Meta-Reinforcement Learning and Online LQR9 Dec 2023
32 more
- 2023Data-Efficient Task Generalization via Probabilistic Model-based Meta Reinforcement Learning13 Nov 2023
- 2023Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptation7 Nov 2023
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligence2 May 2023
- 2023Learning How to Infer Partial MDPs for In-Context Adaptation and Exploration8 Feb 2023
- 2022Continual Vision-based Reinforcement Learning with Group Symmetries21 Oct 2022
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizability16 Sep 2022
- 2022A model-based approach to meta-Reinforcement Learning: Transformers and tree search24 Aug 2022
- 2022Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarios29 Jun 2022
- 2022A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning9 Jun 2022
- 2022Online No-regret Model-Based Meta RL for Personalized Navigation5 Apr 2022
- 2021CoMPS: Continual Meta Policy Search8 Dec 2021
- 2021MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerance7 Dec 2021
- 2021Robust and Adaptive Temporal-Difference Learning Using An Ensemble of Gaussian Processes1 Dec 2021
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-making28 Oct 2021
- 2021Learning Robust Controllers Via Probabilistic Model-Based Policy Search26 Oct 2021
- 2021Bayesian Meta-Learning Through Variational Gaussian Processes21 Oct 2021
- 2021Learning to Transfer: A Foliated Theory22 Jul 2021
- 2021Robustifying Reinforcement Learning Policies with L1 Adaptive Control4 Jun 2021
- 2021MetaKernel: Learning Variational Random Features with Limited Labels8 May 2021
- 2021Adaptive Adversarial Training for Meta Reinforcement Learning27 Apr 2021
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Models12 Apr 2021
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning10 Mar 2021
- 2021Deep reinforcement learning in medical imaging: A literature review5 Mar 2021
- 2021Explore the Context: Optimal Data Collection for Context-Conditional Dynamics Models22 Feb 2021
- 2021Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models16 Feb 2021
- 2021PerSim: Data-Efficient Offline Reinforcement Learning with Heterogeneous Agents via Personalized Simulators13 Feb 2021
- 2021Meta-Reinforcement Learning for Adaptive Motor Control in Changing Robot Dynamics and Environments19 Jan 2021
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environments2 Jan 2021
- 2020Offline Meta-Reinforcement Learning with Advantage Weighting13 Aug 2020
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variables20 Sep 2019
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Reward7 Jun 2019
- 2020Offline Meta-Reinforcement Learning with Advantage Weightingcited by 92
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Rewardcited by 26
- 2021PerSim: Data-Efficient Offline Reinforcement Learning with Heterogeneous Agents via Personalized Simulatorscited by 10
- 2021PerSim: Data-Efficient Offline Reinforcement Learning with Heterogeneous Agents via Personalized Simulators13 Feb 2021
- 2020Offline Meta-Reinforcement Learning with Advantage Weighting13 Aug 2020
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variables20 Sep 2019
- 2019Watch, Try, Learn: Meta-Learning from Demonstrations and Reward7 Jun 2019
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 55
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environmentscited by 33
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 32
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2021Model-based Meta Reinforcement Learning using Graph Structured Surrogate Modelscited by 16
- 2021CoMPS: Continual Meta Policy Searchcited by 15
- 2022A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learningcited by 15
- 2025Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planningcited by 12
- 2022Continual Vision-based Reinforcement Learning with Group Symmetriescited by 10
- 2021Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learningcited by 8
12 most cited of 38 All 38 (JSON)
- 2026Hierarchical Belief Modeling for Zero-Shot Opponent Adaptation in Partially Observable Multi-Agent Navigation11 Sep 2026
- 2026MetaKoopman: Bayesian Meta-Learning of Koopman Operators for Modeling Structured Dynamics under Distribution Shifts28 Jul 2026
- 2025Improving Forecasts of Suicide Attempts for Patients with Little Data22 Nov 2025
- 2025Linear Mixture Distributionally Robust Markov Decision Processes23 May 2025
- 2025Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimization19 May 2025
- 2025Improving Controller Generalization with Dimensionless Markov Decision Processes14 Apr 2025
- 2025Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planning26 Feb 2025
- 2025PrivilegedDreamer: Explicit Imagination of Privileged Information for Rapid Adaptation of Learned Policies17 Feb 2025
- 2024Systems with Switching Causal Relations: A Meta-Causal Perspective16 Oct 2024
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfer6 May 2024
- 2023On Task-Relevant Loss Functions in Meta-Reinforcement Learning and Online LQR9 Dec 2023
- 2023Data-Efficient Task Generalization via Probabilistic Model-based Meta Reinforcement Learning13 Nov 2023
12 newest of 38 All 38 (JSON)