Myriad: a real-world testbed to bridge trajectory optimization and deep learning
Not on the map. Why?
Abstract (arXiv)
We present Myriad, a testbed written in JAX for learning and planning in real-world continuous environments. The primary contributions of Myriad are threefold. First, Myriad provides machine learning practitioners access to trajectory optimization techniques for application within a typical automatic differentiation workflow. Second, Myriad presents many real-world optimal control problems, ranging from biology to medicine to engineering, for use by the machine learning community. Formulated in continuous space and time, these environments retain some of the complexity of real-world systems often abstracted away by standard benchmarks. As such, Myriad strives to serve as a stepping stone towards application of modern machine learning techniques for impactful real-world tasks. Finally, we use the Myriad repository to showcase a novel approach for learning and control tasks. Trained in a fully end-to-end fashion, our model leverages an implicit planning module over neural ordinary differential equations, enabling simultaneous learning and planning with complex environment dynamics.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 21 of its 90 references that are in the map. First posted on arXiv 22 Feb 2022.
Builds on
21 of 90 references.
References · 21
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016OpenAI Gymcited by 1,684
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 776
- 2017Deep Reinforcement Learning that Matterscited by 727
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
- 2018Scalable agent alignment via reward modeling: a research directioncited by 438
- 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 357
- 2014Identifying and attacking the saddle point problem in high-dimensional non-convex optimizationcited by 286
- 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 266
- 2018Differentiable MPC for End-to-end Planning and Controlcited by 178
9 more
- 2016Value Iteration Networkscited by 158
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2018A Variational Inequality Perspective on Generative Adversarial Networkscited by 144
- 2016On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimizationcited by 108
- 2019Pontryagin Differentiable Programming: An End-to-End Learning and Control Frameworkcited by 48
- 2020DyNODE: Neural Ordinary Differential Equations for Dynamics Modeling in Continuous Controlcited by 17
- 2020XLVIN: eXecuted Latent Value Iteration Netscited by 17
- 2017Path Integral Networks: End-to-End Differentiable Optimal Controlcited by 16
- 2018MPC-Inspired Neural Network Policies for Sequential Decision Makingcited by 13
Built on by
Citing papers per year: 2023: 1; 2024: 4.
5 papers.
- 2023Efficient Exploration in Continuous-time Model-based Reinforcement Learningcited by 21
- 2024Do Transformer World Models Give Better Policy Gradients?cited by 10
- 2024Efficient Trajectory Inference in Wasserstein Space Using Consecutive Averagingcited by 9
- 2024A Pontryagin Perspective on Reinforcement Learningcited by 7
- 2024CALE: Continuous Arcade Learning Environmentcited by 5
- 2024CALE: Continuous Arcade Learning Environment31 Oct 2024
- 2024Efficient Trajectory Inference in Wasserstein Space Using Consecutive Averaging30 May 2024
- 2024A Pontryagin Perspective on Reinforcement Learning28 May 2024
- 2024Do Transformer World Models Give Better Policy Gradients?7 Feb 2024
- 2023Efficient Exploration in Continuous-time Model-based Reinforcement Learning30 Oct 2023