Model Predictive Path Integral Control using Covariance Variable Importance Sampling
Not on the map. Why?
Cited by 33 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper we develop a Model Predictive Path Integral (MPPI) control algorithm based on a generalized importance sampling scheme and perform parallel optimization via sampling using a Graphics Processing Unit (GPU). The proposed generalized importance sampling scheme allows for changes in the drift and diffusion terms of stochastic diffusion processes and plays a significant role in the performance of the model predictive control algorithm. We compare the proposed algorithm in simulation with a model predictive control version of differential dynamic programming.
Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 13; 2023: 25; 2024: 21; 2025: 26; 2026: 29.
122 papers.
Sort:
By area:
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2022Temporal Difference Learning for Model Predictive Controlcited by 375
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 147
- 2021Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skillscited by 125
- 2023Optimal Goal-Reaching Reinforcement Learning via Quasimetric Learningcited by 116
- 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 113
- 20213D Neural Scene Representations for Visuomotor Controlcited by 110
- 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 77
38 more
- 2022A Survey on Model-based Reinforcement Learningcited by 65
- 2021Plan Better Amid Conservatism: Offline Multi-Agent Reinforcement Learning with Actor Rectificationcited by 59
- 2022MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrationscited by 59
- 2022Skill-based Model-based Reinforcement Learningcited by 50
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planningcited by 49
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Followingcited by 41
- 2023Finetuning Offline World Models in the Real Worldcited by 39
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 37
- 2021Autoregressive Dynamics Models for Offline Policy Evaluation and Optimizationcited by 32
- 2026Temporal Straightening for Latent Planningcited by 32
- 2022A General Framework for Sample-Efficient Function Approximation in Reinforcement Learningcited by 31
- 2024Diffusion World Model: Future Modeling Beyond Step-by-Step Rollout for Offline Reinforcement Learningcited by 31
- 2022Composing Ensembles of Pre-trained Models via Iterative Consensuscited by 28
- 2023Planning Goals for Explorationcited by 28
- 2023Refining Diffusion Planner for Reliable Behavior Synthesis by Automatic Detection of Infeasible Planscited by 27
- 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 25
- 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllerscited by 24
- 2025Critique of World Modelcited by 24
- 2022Mastering the Unsupervised Reinforcement Learning Benchmark from Pixelscited by 20
- 2023Efficient Preference-Based Reinforcement Learning Using Learned Dynamics Modelscited by 20
- 2023TWIST: Teacher-Student World Model Distillation for Efficient Sim-to-Real Transfercited by 18
- 2023Simplified Temporal Consistency Reinforcement Learningcited by 17
- 2023Fighting Uncertainty with Gradients: Offline Reinforcement Learning via Diffusion Score Matchingcited by 17
- 2024Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inferencecited by 15
- 2023IQL-TD-MPC: Implicit Q-Learning for Hierarchical Model Predictive Controlcited by 14
- 2026VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World Modelscited by 14
- 2024Resisting Stochastic Risks in Diffusion Planners with the Trajectory Aggregation Treecited by 13
- 2025Bootstrapped Model Predictive Controlcited by 13
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 13
- 2025Learning Massively Multitask World Models for Continuous Controlcited by 11
- 2023Efficient Dynamics Modeling in Interactive Environments with Koopman Theorycited by 10
- 2025Multi-Stage Manipulation with Demonstration-Augmented Reward, Policy, and World Model Learningcited by 10
- 2023Smoothed Online Learning for Prediction in Piecewise Affine Systemscited by 9
- 2023Multi-Object Manipulation via Object-Centric Neural Scattering Functionscited by 9
- 2024iQRL -- Implicitly Quantized Representations for Sample-efficient Reinforcement Learningcited by 9
- 2025Discrete Codebook World Models for Continuous Controlcited by 9
- 2022EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Modelcited by 8
- 2023Decision Stacks: Flexible Reinforcement Learning via Modular Generative Modelscited by 8
50 most cited of 122 All 122 (JSON)
- 2026Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaos1 Oct 2026
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPC26 Sep 2026
- 2026Generalizable Robotic Insertion with World Models23 Sep 2026
- 2026Amortized Low-Rank Adaptation for Model-Based Reinforcement Learning10 Sep 2026
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution29 Aug 2026
- 2026Progressive Experience Fusion for Multi-Task World Model Control in Endovascular Navigation19 Aug 2026
- 2026Orbit-Planner: Towards Latent World Models for On-Orbit Obstacle Avoidance of Satellite Agents17 Aug 2026
- 2026Reinforcement Learning: From Algorithms To Foundation Models20 Jul 2026
- 2026Adapting Generalist Vehicle Models for High-Speed MPC Across Terrains14 Jul 2026
- 2026EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video15 Jun 2026
- 2026Post-Hoc Robustness for Model-Based Reinforcement Learning2 Jun 2026
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization25 May 2026
38 more
- 2026Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations14 May 2026
- 2026Dream-MPC: Gradient-Based Model Predictive Control with Latent Imagination6 May 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems15 Mar 2026
- 2026Data-Driven Physics Embedded Dynamics with Predictive Control and Reinforcement Learning for Quadrupeds15 Mar 2026
- 2026Temporal Straightening for Latent Planning12 Mar 2026
- 2026Safe Probabilistic Planning for Human-Robot Interaction using Conformal Risk Control11 Mar 2026
- 2026TADPO: Reinforcement Learning Goes Off-road6 Mar 2026
- 2026Accelerated Sequential Flow Matching: A Bayesian Filtering Perspective5 Feb 2026
- 2026SLOPE: Optimistic Potential Landscape Shaping for Model-based Reinforcement Learning3 Feb 2026
- 2026The Surprising Difficulty of Search in Model-Based Reinforcement Learning29 Jan 2026
- 2026VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World Models20 Jan 2026
- 2026Failure-Aware RL: Reliable Offline-to-Online Reinforcement Learning with Self-Recovery for Real-World Manipulation12 Jan 2026
- 2026Object-Centric World Models Meet Monte Carlo Tree Search10 Jan 2026
- 2026Autonomous Discovery of the Ising Model's Critical Parameters with Reinforcement Learning9 Jan 2026
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?30 Dec 2025
- 2025TongSIM: A General Platform for Simulating Intelligent Machines23 Dec 2025
- 2025SIMPACT: Simulation-Enabled Action Planning using Vision-Language Models5 Dec 2025
- 2025Learning Massively Multitask World Models for Continuous Control24 Nov 2025
- 2025Expressive Value Learning for Scalable Offline Reinforcement Learning9 Oct 2025
- 2025PAD-TRO: Projection-Augmented Diffusion for Direct Trajectory Optimization6 Oct 2025
- 2025D2 Actor Critic: Diffusion Actor Meets Distributional Critic3 Oct 2025
- 2025Reservoir Predictive Path Integral Control for Unknown Nonlinear Dynamics4 Sep 2025
- 2025Continual Reinforcement Learning by Planning with Online World Models12 Jul 2025
- 2025Critique of World Model7 Jul 2025
- 2025M3PO: Massively Multi-Task Model-Based Policy Optimization26 Jun 2025
- 2025Investigating Lagrangian Neural Networks for Infinite Horizon Planning in Quadrupedal Locomotion19 Jun 2025
- 2025Reflect-then-Plan: Offline Model-Based Planning through a Doubly Bayesian Lens6 Jun 2025
- 2025Enter the Void - Planning to Seek Entropy When Reward is Scarce22 May 2025
- 2025Coupled Distributional Random Expert Distillation for World Model Online Imitation Learning4 May 2025
- 2025Trust-Region Twisted Policy Improvement8 Apr 2025
- 2025Bootstrapped Model Predictive Control24 Mar 2025
- 2025KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation13 Mar 2025
- 2025Knowledge Retention for Continual Model-Based Reinforcement Learning6 Mar 2025
- 2025Multi-Stage Manipulation with Demonstration-Augmented Reward, Policy, and World Model Learning3 Mar 2025
- 2025Discrete Codebook World Models for Continuous Control1 Mar 2025
50 newest of 122 All 122 (JSON)
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2022Temporal Difference Learning for Model Predictive Controlcited by 375
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2022A Survey on Model-based Reinforcement Learningcited by 65
- 2023Finetuning Offline World Models in the Real Worldcited by 39
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 37
- 2026Temporal Straightening for Latent Planningcited by 32
- 2024Diffusion World Model: Future Modeling Beyond Step-by-Step Rollout for Offline Reinforcement Learningcited by 31
- 2024Hierarchical World Models as Visual Whole-Body Humanoid Controllerscited by 24
- 2025Critique of World Modelcited by 24
- 2023TWIST: Teacher-Student World Model Distillation for Efficient Sim-to-Real Transfercited by 18
- 2026VJEPA: Variational Joint Embedding Predictive Architectures as Probabilistic World Modelscited by 14
12 most cited of 33 All 33 (JSON)
- 2026Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPC26 Sep 2026
- 2026Generalizable Robotic Insertion with World Models23 Sep 2026
- 2026Amortized Low-Rank Adaptation for Model-Based Reinforcement Learning10 Sep 2026
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution29 Aug 2026
- 2026Progressive Experience Fusion for Multi-Task World Model Control in Endovascular Navigation19 Aug 2026
- 2026Orbit-Planner: Towards Latent World Models for On-Orbit Obstacle Avoidance of Satellite Agents17 Aug 2026
- 2026Reinforcement Learning: From Algorithms To Foundation Models20 Jul 2026
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization25 May 2026
- 2026Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations14 May 2026
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr 2026
- 2026WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems15 Mar 2026
- 2026Temporal Straightening for Latent Planning12 Mar 2026
12 newest of 33 All 33 (JSON)
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 147
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planningcited by 49
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Followingcited by 41
- 2023Refining Diffusion Planner for Reliable Behavior Synthesis by Automatic Detection of Infeasible Planscited by 27
- 2025Expressive Value Learning for Scalable Offline Reinforcement Learningcited by 6
- 2026Accelerated Sequential Flow Matching: A Bayesian Filtering Perspectivecited by 1
- 2025D2 Actor Critic: Diffusion Actor Meets Distributional Criticcited by 0
- 2025PAD-TRO: Projection-Augmented Diffusion for Direct Trajectory Optimizationcited by 0
- 2026Accelerated Sequential Flow Matching: A Bayesian Filtering Perspective5 Feb 2026
- 2025Expressive Value Learning for Scalable Offline Reinforcement Learning9 Oct 2025
- 2025PAD-TRO: Projection-Augmented Diffusion for Direct Trajectory Optimization6 Oct 2025
- 2025D2 Actor Critic: Diffusion Actor Meets Distributional Critic3 Oct 2025
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion1 Jul 2024
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following9 Feb 2024
- 2023Refining Diffusion Planner for Reliable Behavior Synthesis by Automatic Detection of Infeasible Plans30 Oct 2023
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planning20 Sep 2023
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners3 Feb 2023
- 2021Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skillscited by 125
- 2021Plan Better Amid Conservatism: Offline Multi-Agent Reinforcement Learning with Actor Rectificationcited by 59
- 2023Fighting Uncertainty with Gradients: Offline Reinforcement Learning via Diffusion Score Matchingcited by 17
- 2023IQL-TD-MPC: Implicit Q-Learning for Hierarchical Model Predictive Controlcited by 14
- 2026Failure-Aware RL: Reliable Offline-to-Online Reinforcement Learning with Self-Recovery for Real-World Manipulationcited by 6
- 2024DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learningcited by 5
- 2023Get Back Here: Robust Imitation by Return-to-Distribution Planningcited by 4
- 2025Reflect-then-Plan: Offline Model-Based Planning through a Doubly Bayesian Lenscited by 4
- 2024Zero-Shot Offline Imitation Learning via Optimal Transportcited by 3
- 2026Failure-Aware RL: Reliable Offline-to-Online Reinforcement Learning with Self-Recovery for Real-World Manipulation12 Jan 2026
- 2025Reflect-then-Plan: Offline Model-Based Planning through a Doubly Bayesian Lens6 Jun 2025
- 2024Zero-Shot Offline Imitation Learning via Optimal Transport11 Oct 2024
- 2024DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning8 Feb 2024
- 2023Fighting Uncertainty with Gradients: Offline Reinforcement Learning via Diffusion Score Matching24 Jun 2023
- 2023IQL-TD-MPC: Implicit Q-Learning for Hierarchical Model Predictive Control1 Jun 2023
- 2023Get Back Here: Robust Imitation by Return-to-Distribution Planning2 May 2023
- 2021Plan Better Amid Conservatism: Offline Multi-Agent Reinforcement Learning with Actor Rectification22 Nov 2021
- 2021Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skills15 Apr 2021
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2023Optimal Goal-Reaching Reinforcement Learning via Quasimetric Learningcited by 116
- 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 113
- 20213D Neural Scene Representations for Visuomotor Controlcited by 110
- 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 77
- 2022MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrationscited by 59
- 2022Skill-based Model-based Reinforcement Learningcited by 50
- 2021Autoregressive Dynamics Models for Offline Policy Evaluation and Optimizationcited by 32
- 2022A General Framework for Sample-Efficient Function Approximation in Reinforcement Learningcited by 31
- 2022Composing Ensembles of Pre-trained Models via Iterative Consensuscited by 28
- 2023Planning Goals for Explorationcited by 28
- 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 25
12 most cited of 63 All 63 (JSON)
- 2026Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaos1 Oct 2026
- 2026Adapting Generalist Vehicle Models for High-Speed MPC Across Terrains14 Jul 2026
- 2026EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video15 Jun 2026
- 2026Post-Hoc Robustness for Model-Based Reinforcement Learning2 Jun 2026
- 2026Dream-MPC: Gradient-Based Model Predictive Control with Latent Imagination6 May 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026Data-Driven Physics Embedded Dynamics with Predictive Control and Reinforcement Learning for Quadrupeds15 Mar 2026
- 2026Safe Probabilistic Planning for Human-Robot Interaction using Conformal Risk Control11 Mar 2026
- 2026TADPO: Reinforcement Learning Goes Off-road6 Mar 2026
- 2026SLOPE: Optimistic Potential Landscape Shaping for Model-based Reinforcement Learning3 Feb 2026
- 2026The Surprising Difficulty of Search in Model-Based Reinforcement Learning29 Jan 2026
12 newest of 63 All 63 (JSON)