Variational Inference MPC using Tsallis Divergence
Not on the map. Why?
Abstract (arXiv)
In this paper, we provide a generalized framework for Variational Inference-Stochastic Optimal Control by using thenon-extensive Tsallis divergence. By incorporating the deformed exponential function into the optimality likelihood function, a novel Tsallis Variational Inference-Model Predictive Control algorithm is derived, which includes prior works such as Variational Inference-Model Predictive Control, Model Predictive PathIntegral Control, Cross Entropy Method, and Stein VariationalInference Model Predictive Control as special cases. The proposed algorithm allows for effective control of the cost/reward transform and is characterized by superior performance in terms of mean and variance reduction of the associated cost. The aforementioned features are supported by a theoretical and numerical analysis on the level of risk sensitivity of the proposed algorithm as well as simulation experiments on 5 different robotic systems with 3 different policy parameterizations.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
19 of 36 references.
References · 19
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2017Advances in Variational Inferencecited by 236
- 2016R'enyi Divergence Variational Inferencecited by 104
- 2017Information Theoretic Model Predictive Control: Theory and Applications to Autonomous Drivingcited by 81
- 2020Learning Robot Skills with Temporal Variational Inferencecited by 54
- 2017Message Passing Stein Variational Gradient Descentcited by 47
- 2019Variational Inference MPC for Bayesian Model-based Reinforcement Learningcited by 39
- 2020Stein Variational Model Predictive Controlcited by 29
- 2020f-Divergence Variational Inferencecited by 28
- 2018Variational Inference with Tail-adaptive f-Divergencecited by 25
- 2019FlightGoggles: A Modular Framework for Photorealistic Camera, Exteroceptive Sensor, and Dynamics Simulationcited by 20
7 more
- 2019Tsallis Reinforcement Learning: A Unified Framework for Maximum Entropy Reinforcement Learningcited by 18
- 2018Alpha-Beta Divergence For Variational Inferencecited by 12
- 2019Non-Smooth Newton Methods for Deformable Multi-Body Dynamicscited by 7
- 2013Gradient-Based Adaptive Stochastic Search for Non-Differentiable Optimizationcited by 4
- 2019Constrained Sampling-based Trajectory Optimization using Stochastic Approximationcited by 3
- 2018Information Theoretic Model Predictive Control on Jump Diffusion Processescited by 1
- 2020Adaptive Risk Sensitive Model Predictive Control with Stochastic Searchcited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 3; 2025: 3.
11 papers.
- 2022Your Policy Regularizer is Secretly an Adversarycited by 21
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projectioncited by 13
- 2022Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processescited by 10
- 2023Constrained Stein Variational Trajectory Optimizationcited by 8
- 2024CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Designcited by 3
- 2024Information-Theoretic Measures on Lattices for High-Order Interactionscited by 3
- 2024Risk-sensitive control as inference with R'enyi divergencecited by 3
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Taskscited by 3
- 2023NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Predictioncited by 0
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functionscited by 0
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identificationcited by 0
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identification31 May 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Tasks19 Feb 2025
- 2024Risk-sensitive control as inference with R'enyi divergence4 Nov 2024
- 2024Information-Theoretic Measures on Lattices for High-Order Interactions14 Aug 2024
- 2024CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design14 Jan 2024
- 2023Constrained Stein Variational Trajectory Optimization23 Aug 2023
- 2023NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Prediction28 May 2023
- 2022Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processes7 Oct 2022
- 2022Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projection10 May 2022
- 2022Your Policy Regularizer is Secretly an Adversary23 Mar 2022