Predictive Sampling: Real-time Behaviour Synthesis with MuJoCo
Not on the map. Why?
Abstract (arXiv)
We introduce MuJoCo MPC (MJPC), an open-source, interactive application and software framework for real-time predictive control, based on MuJoCo physics. MJPC allows the user to easily author and solve complex robotics tasks, and currently supports three shooting-based planners: derivative-based iLQG and Gradient Descent, and a simple derivative-free method we call Predictive Sampling. Predictive Sampling was designed as an elementary baseline, mostly for its pedagogical value, but turned out to be surprisingly competitive with the more established algorithms. This work does not present algorithmic advances, and instead, prioritises performant algorithms, simple code, and accessibility of model-based methods via intuitive and interactive software. MJPC is available at: github.com/deepmind/mujoco_mpc, a video summary can be viewed at: dpmd.ai/mjpc.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Dec 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 7; 2024: 6; 2025: 17; 2026: 9.
39 papers.
Sort:
By area:
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2023Language to Rewards for Robotic Skill Synthesiscited by 307
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2025Zero-Shot Whole-Body Humanoid Control via Behavioral Foundation Modelscited by 51
- 2023RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learningcited by 29
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 25
- 2025Physics-Driven Data Generation for Contact-Rich Manipulation via Trajectory Optimizationcited by 20
- 2026stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluationcited by 13
- 2025SIMPACT: Simulation-Enabled Action Planning using Vision-Language Modelscited by 7
- 2025Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Controlcited by 5
27 more
- 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulationcited by 4
- 2023Toward Open-ended Embodied Tasks Solvingcited by 3
- 2025Scalable, Training-Free Visual Language Robotics: A Modular Multi-Model Framework for Consumer-Grade GPUscited by 3
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Taskscited by 3
- 2024Training Fast Robot Policies with Slow Foundation Modelscited by 2
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feedingcited by 2
- 2025Robust Reward Alignment via Hypothesis Space Batch Cuttingcited by 2
- 2025Diffusion-based Planning with Learned Viability Filterscited by 2
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulationcited by 2
- 2024Latent Linear Quadratic Regulator for Robotic Control Taskscited by 1
- 2024Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulatorscited by 1
- 2025Multi-person Physics-based Pose Estimation for Combat Sportscited by 1
- 2025Bipedal Balance Control with Whole-body Musculoskeletal Standing and Falling Simulationscited by 1
- 2026Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradientcited by 1
- 2026Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objectscited by 1
- 2023Reinforcement Learning in a Safety-Embedded MDP with Trajectory Optimizationcited by 0
- 2024MuJoCo MPC for Humanoid Control: Evaluation on HumanoidBenchcited by 0
- 2025Model Tensor Planningcited by 0
- 2025Training Environment for High Performance Reinforcement Learningcited by 0
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllerscited by 0
- 2025Learning Contact Dynamics through Touching: Action-conditional Graph Neural Networks for Robotic Peg Insertioncited by 0
- 2026Approximately Optimal Global Planning for Contact-Rich SE(2) Manipulation on a Graph of Reachable Setscited by 0
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamicscited by 0
- 2026TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulationcited by 0
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RLcited by 0
- 2026Accelerating Visual Policy Learning with Sampling-Based Model Predictive Controlcited by 0
- 2026Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaoscited by 0
- 2026Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaos1 Oct 2026
- 2026Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control17 Sep 2026
- 2026Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL12 Aug 2026
- 2026TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulation4 Jun 2026
- 2026Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objects1 Jun 2026
- 2026Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradient26 May 2026
- 2026stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation20 May 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026Approximately Optimal Global Planning for Contact-Rich SE(2) Manipulation on a Graph of Reachable Sets15 Jan 2026
- 2025SIMPACT: Simulation-Enabled Action Planning using Vision-Language Models5 Dec 2025
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargeting12 Nov 2025
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulation16 Oct 2025
27 more
- 2025Learning Contact Dynamics through Touching: Action-conditional Graph Neural Networks for Robotic Peg Insertion15 Sep 2025
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllers17 Jun 2025
- 2025Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Control17 Jun 2025
- 2025Bipedal Balance Control with Whole-body Musculoskeletal Standing and Falling Simulations11 Jun 2025
- 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulation15 May 2025
- 2025Training Environment for High Performance Reinforcement Learning4 May 2025
- 2025Model Tensor Planning2 May 2025
- 2025Zero-Shot Whole-Body Humanoid Control via Behavioral Foundation Models15 Apr 2025
- 2025Multi-person Physics-based Pose Estimation for Combat Sports11 Apr 2025
- 2025Physics-Driven Data Generation for Contact-Rich Manipulation via Trajectory Optimization27 Feb 2025
- 2025Diffusion-based Planning with Learned Viability Filters26 Feb 2025
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Tasks19 Feb 2025
- 2025Robust Reward Alignment via Hypothesis Space Batch Cutting5 Feb 2025
- 2025Scalable, Training-Free Visual Language Robotics: A Modular Multi-Model Framework for Consumer-Grade GPUs3 Feb 2025
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feeding13 Oct 2024
- 2024Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators20 Sep 2024
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep 2024
- 2024MuJoCo MPC for Humanoid Control: Evaluation on HumanoidBench1 Aug 2024
- 2024Latent Linear Quadratic Regulator for Robotic Control Tasks15 Jul 2024
- 2024Training Fast Robot Policies with Slow Foundation Models9 Jun 2024
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis14 Dec 2023
- 2023Toward Open-ended Embodied Tasks Solving10 Dec 2023
- 2023Eureka: Human-Level Reward Design via Coding Large Language Models19 Oct 2023
- 2023Reinforcement Learning in a Safety-Embedded MDP with Trajectory Optimization10 Oct 2023
- 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learning20 Sep 2023
- 2023Language to Rewards for Robotic Skill Synthesis14 Jun 2023
- 2023RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning9 Apr 2023
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Taskscited by 3
- 2025Diffusion-based Planning with Learned Viability Filterscited by 2
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulationcited by 2
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulation16 Oct 2025
- 2025Diffusion-based Planning with Learned Viability Filters26 Feb 2025
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Tasks19 Feb 2025
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2025Zero-Shot Whole-Body Humanoid Control via Behavioral Foundation Modelscited by 51
- 2023RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learningcited by 29
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 25
- 2025Physics-Driven Data Generation for Contact-Rich Manipulation via Trajectory Optimizationcited by 20
- 2025Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Controlcited by 5
- 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulationcited by 4
- 2023Toward Open-ended Embodied Tasks Solvingcited by 3
- 2024Training Fast Robot Policies with Slow Foundation Modelscited by 2
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feedingcited by 2
- 2024Latent Linear Quadratic Regulator for Robotic Control Taskscited by 1
- 2024Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulatorscited by 1
12 most cited of 26 All 26 (JSON)
- 2026Bellman Meets Lyapunov: Unsupervised Reinforcement Learning via Mastering Chaos1 Oct 2026
- 2026Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control17 Sep 2026
- 2026TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulation4 Jun 2026
- 2026Efficient On-policy Visual-RL via Stochastic Decoupled Policy Gradient26 May 2026
- 2026Tempered Sequential Monte Carlo for Trajectory and Policy Optimization with Differentiable Dynamics23 Apr 2026
- 2026Approximately Optimal Global Planning for Contact-Rich SE(2) Manipulation on a Graph of Reachable Sets15 Jan 2026
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargeting12 Nov 2025
- 2025Learning Contact Dynamics through Touching: Action-conditional Graph Neural Networks for Robotic Peg Insertion15 Sep 2025
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllers17 Jun 2025
- 2025Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Control17 Jun 2025
- 2025Bipedal Balance Control with Whole-body Musculoskeletal Standing and Falling Simulations11 Jun 2025
- 2025Accelerating Visual-Policy Learning through Parallel Differentiable Simulation15 May 2025
12 newest of 26 All 26 (JSON)