Stein Variational Model Predictive Control
Not on the map. Why?
Abstract (arXiv)
Decision making under uncertainty is critical to real-world, autonomous systems. Model Predictive Control (MPC) methods have demonstrated favorable performance in practice, but remain limited when dealing with complex probability distributions. In this paper, we propose a generalization of MPC that represents a multitude of solutions as posterior distributions. By casting MPC as a Bayesian inference problem, we employ variational methods for posterior computation, naturally encoding the complexity and multi-modality of the decision making problem. We present a Stein variational gradient descent method to estimate the posterior directly over control parameters, given a cost function and observed state trajectories. We show that this framework leads to successful planning in challenging, non-convex optimal control problems.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 5; 2024: 6; 2025: 5; 2026: 2.
30 papers.
Sort:
By area:
- 2022Learning Implicit Priors for Motion Optimizationcited by 20
- 2021Probabilistic Inference of Simulation Parameters via Parallel Differentiable Simulationcited by 17
- 2021Composable Energy Policies for Reactive Motion Generation and Reinforcement Learningcited by 16
- 2024Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descentcited by 14
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projectioncited by 13
- 2021Variational Inference MPC using Tsallis Divergencecited by 11
- 2021Dual Online Stein Variational Inference for Control and Dynamicscited by 10
- 2022Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processescited by 10
- 2022Learning Sampling Distributions for Model Predictive Controlcited by 10
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Controlcited by 8
- 2023Constrained Stein Variational Trajectory Optimizationcited by 8
- 2023Deep Model Predictive Optimizationcited by 7
18 more
- 2023STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descentcited by 4
- 2024Wasserstein Gradient Boosting: A Framework for Distribution-Valued Supervised Learningcited by 4
- 2021Efficient Stochastic Optimal Control through Approximate Bayesian Input Inferencecited by 3
- 2023Path Signatures for Diversity in Probabilistic Trajectory Optimisationcited by 3
- 2024Risk-sensitive control as inference with R'enyi divergencecited by 3
- 2023DiSProD: Differentiable Symbolic Propagation of Distributions for Planningcited by 2
- 2024Stein Variational Evolution Strategiescited by 2
- 2024Global Tensor Motion Planningcited by 2
- 2022Optimisation of Structured Neural Controller Based on Continuous-Time Policy Gradientcited by 1
- 2022Decision-Making Among Bounded Rational Agentscited by 1
- 2024Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fieldscited by 1
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functionscited by 1
- 2025A Taxonomy of Self-Handovercited by 0
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identificationcited by 0
- 2025Q-Guided Stein Variational Model Predictive Control via RL-informed Policy Priorcited by 0
- 2025Test-time reward-guided alignment of language models by importance sampling on pre-logit spacecited by 0
- 2026BayesFP: Posterior Estimation for Flow-Based Policies via Feynman-Kac Samplingcited by 0
- 2026P3: Persistent Particle Planning for Constrained Diffusion Controlcited by 0
- 2026P3: Persistent Particle Planning for Constrained Diffusion Control5 Oct 2026
- 2026BayesFP: Posterior Estimation for Flow-Based Policies via Feynman-Kac Sampling19 Jun 2026
- 2025Test-time reward-guided alignment of language models by importance sampling on pre-logit space30 Oct 2025
- 2025Q-Guided Stein Variational Model Predictive Control via RL-informed Policy Prior9 Jul 2025
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identification31 May 2025
- 2025A Taxonomy of Self-Handover7 Apr 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2024Global Tensor Motion Planning28 Nov 2024
- 2024Risk-sensitive control as inference with R'enyi divergence4 Nov 2024
- 2024Stein Variational Evolution Strategies14 Oct 2024
- 2024Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent13 Sep 2024
- 2024Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields6 Sep 2024
18 more
- 2024Wasserstein Gradient Boosting: A Framework for Distribution-Valued Supervised Learning15 May 2024
- 2023Deep Model Predictive Optimization6 Oct 2023
- 2023STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descent3 Oct 2023
- 2023Constrained Stein Variational Trajectory Optimization23 Aug 2023
- 2023Path Signatures for Diversity in Probabilistic Trajectory Optimisation8 Aug 2023
- 2023DiSProD: Differentiable Symbolic Propagation of Distributions for Planning3 Feb 2023
- 2022Learning Sampling Distributions for Model Predictive Control5 Dec 2022
- 2022Decision-Making Among Bounded Rational Agents17 Oct 2022
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Control14 Oct 2022
- 2022Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processes7 Oct 2022
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projection10 May 2022
- 2022Learning Implicit Priors for Motion Optimization11 Apr 2022
- 2022Optimisation of Structured Neural Controller Based on Continuous-Time Policy Gradient17 Jan 2022
- 2021Probabilistic Inference of Simulation Parameters via Parallel Differentiable Simulation18 Sep 2021
- 2021Efficient Stochastic Optimal Control through Approximate Bayesian Input Inference17 May 2021
- 2021Composable Energy Policies for Reactive Motion Generation and Reinforcement Learning11 May 2021
- 2021Variational Inference MPC using Tsallis Divergence1 Apr 2021
- 2021Dual Online Stein Variational Inference for Control and Dynamics23 Mar 2021
- 2024Global Tensor Motion Planningcited by 2
- 2024Global Tensor Motion Planning28 Nov 2024
- 2022Learning Implicit Priors for Motion Optimizationcited by 20
- 2021Probabilistic Inference of Simulation Parameters via Parallel Differentiable Simulationcited by 17
- 2021Composable Energy Policies for Reactive Motion Generation and Reinforcement Learningcited by 16
- 2024Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descentcited by 14
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projectioncited by 13
- 2021Variational Inference MPC using Tsallis Divergencecited by 11
- 2021Dual Online Stein Variational Inference for Control and Dynamicscited by 10
- 2022Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processescited by 10
- 2022Learning Sampling Distributions for Model Predictive Controlcited by 10
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Controlcited by 8
- 2023Constrained Stein Variational Trajectory Optimizationcited by 8
- 2023Deep Model Predictive Optimizationcited by 7
12 most cited of 24 All 24 (JSON)
- 2025Q-Guided Stein Variational Model Predictive Control via RL-informed Policy Prior9 Jul 2025
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identification31 May 2025
- 2025A Taxonomy of Self-Handover7 Apr 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2024Stein Variational Evolution Strategies14 Oct 2024
- 2024Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent13 Sep 2024
- 2024Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields6 Sep 2024
- 2024Wasserstein Gradient Boosting: A Framework for Distribution-Valued Supervised Learning15 May 2024
- 2023Deep Model Predictive Optimization6 Oct 2023
- 2023Constrained Stein Variational Trajectory Optimization23 Aug 2023
- 2023Path Signatures for Diversity in Probabilistic Trajectory Optimisation8 Aug 2023
- 2023DiSProD: Differentiable Symbolic Propagation of Distributions for Planning3 Feb 2023
12 newest of 24 All 24 (JSON)