Probabilistic Inference of Simulation Parameters via Parallel Differentiable Simulation
Not on the map. Why?
Abstract (arXiv)
To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through a Bayesian inference approach that approximates a posterior distribution over simulation parameters given real sensor measurements. By extending the commonly used Gaussian likelihood model for trajectories via the multiple-shooting formulation, our chosen particle-based inference algorithm Stein Variational Gradient Descent is able to identify highly nonlinear, underactuated systems. We leverage GPU code generation and differentiable simulation to evaluate the likelihood and its gradient for many particles in parallel. Our algorithm infers non-parametric distributions over simulation parameters more accurately than comparable baselines and handles constraints over parameters efficiently through gradient-based optimization. We evaluate estimation performance on several physical experiments. On an underactuated mechanism where a 7-DOF robot arm excites an object with an unknown mass configuration, we demonstrate how our inference technique can identify symmetries between the parameters and provide highly accurate predictions. Project website: https://uscresl.github.io/prob-diff-sim
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 30 of its 84 references that are in the map. First posted on arXiv 18 Sep 2021.
Builds on
30 of 84 references.
References · 30
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2019The frontier of simulation-based inferencecited by 490
- 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 277
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 203
- 2019Active Domain Randomizationcited by 161
- 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
- 2021PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physicscited by 100
- 2018ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Roboticscited by 98
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 87
18 more
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
- 2019BayesSim: adaptive domain randomization via probabilistic inference for robotics simulatorscited by 78
- 2020NeuralSim: Augmenting Differentiable Simulators with Neural Networkscited by 77
- 2020Scalable Differentiable Physics for Learning and Controlcited by 72
- 2021DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cuttingcited by 62
- 2016Fast ε-free Inference of Simulation Models with Bayesian Conditional Density Estimationcited by 50
- 2020Signatory: differentiable computations of the signature and logsignature transforms, on both CPU and GPUcited by 45
- 2021Auto-Tuned Sim-to-Real Transfercited by 45
- 2020Stein Variational Model Predictive Controlcited by 29
- 2019TuneNet: One-Shot Residual Tuning for System Identification and Sim-to-Real Robot Task Transfercited by 21
- 2020Inferring the Material Properties of Granular Media for Robotic Taskscited by 18
- 2020ADD: Analytically Differentiable Dynamics for Multi-Body Systems with Frictional Contactcited by 17
- 2018Stein Variational Gradient Descent Without Gradientcited by 12
- 2020STReSSD: Sim-To-Real from Sound for Stochastic Dynamicscited by 12
- 2019Physics-based Simulation of Continuous-Wave LIDAR for Localization, Calibration and Trackingcited by 5
- 2020Interpreting and Predicting Tactile Signals via a Physics-Based and Data-Driven Frameworkcited by 5
- 2019Bayesian Learning of Conditional Kernel Mean Embeddings for Automatic Likelihood-Free Inferencecited by 4
- 2020A Modified Multiple Shooting Algorithm for Parameter Estimation in ODEs Using Adjoint Sensitivity Analysiscited by 3
Built on by
Citing papers per year: 2022: 5; 2023: 6; 2024: 2; 2025: 4.
17 papers.
Sort:
By area:
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2022Latent Neural ODEs with Sparse Bayesian Multiple Shootingcited by 17
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfercited by 17
- 2022Inferring Articulated Rigid Body Dynamics from RGBD Videocited by 10
- 2022j-Wave: An open-source differentiable wave simulatorcited by 9
- 2022DiSECt: A Differentiable Simulator for Parameter Inference and Control in Robotic Cuttingcited by 6
- 2024Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materialscited by 6
- 2022Real2Sim2Real Transfer for Control of Cable-driven Robots via a Differentiable Physics Enginecited by 5
- 2023Learning to Simulate Tree-Branch Dynamics for Manipulationcited by 4
- 2023STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descentcited by 4
- 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priorscited by 3
5 more
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interactioncited by 3
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptationcited by 1
- 2023Deep-learning-based decomposition of overlapping-sparse images: application at the vertex of neutrino interactionscited by 0
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identificationcited by 0
- 2025Posterior-driven Heuristic Support Adaptation in a Probabilistic Treatment of Real2Sim2Real for Vision-Driven Deformable Linear Object Manipulationcited by 0
- 2025Posterior-driven Heuristic Support Adaptation in a Probabilistic Treatment of Real2Sim2Real for Vision-Driven Deformable Linear Object Manipulation30 Oct 2025
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identification31 May 2025
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptation11 Apr 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materials1 Nov 2024
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interaction4 Oct 2024
- 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors28 Nov 2023
- 2023Deep-learning-based decomposition of overlapping-sparse images: application at the vertex of neutrino interactions30 Oct 2023
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models27 Oct 2023
- 2023STAMP: Differentiable Task and Motion Planning via Stein Variational Gradient Descent3 Oct 2023
- 2023Learning to Simulate Tree-Branch Dynamics for Manipulation6 Jun 2023
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfer9 Feb 2023
5 more
- 2022Latent Neural ODEs with Sparse Bayesian Multiple Shooting7 Oct 2022
- 2022Real2Sim2Real Transfer for Control of Cable-driven Robots via a Differentiable Physics Engine13 Sep 2022
- 2022j-Wave: An open-source differentiable wave simulator30 Jun 2022
- 2022Inferring Articulated Rigid Body Dynamics from RGBD Video20 Mar 2022
- 2022DiSECt: A Differentiable Simulator for Parameter Inference and Control in Robotic Cutting19 Mar 2022
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2022Latent Neural ODEs with Sparse Bayesian Multiple Shootingcited by 17
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfercited by 17
- 2022Inferring Articulated Rigid Body Dynamics from RGBD Videocited by 10
- 2022j-Wave: An open-source differentiable wave simulatorcited by 9
- 2022DiSECt: A Differentiable Simulator for Parameter Inference and Control in Robotic Cuttingcited by 6
- 2024Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materialscited by 6
- 2022Real2Sim2Real Transfer for Control of Cable-driven Robots via a Differentiable Physics Enginecited by 5
- 2023Learning to Simulate Tree-Branch Dynamics for Manipulationcited by 4
- 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priorscited by 3
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interactioncited by 3
12 most cited of 15 All 15 (JSON)
- 2025Posterior-driven Heuristic Support Adaptation in a Probabilistic Treatment of Real2Sim2Real for Vision-Driven Deformable Linear Object Manipulation30 Oct 2025
- 2025Constrained Stein Variational Gradient Descent for Robot Perception, Planning, and Identification31 May 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materials1 Nov 2024
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interaction4 Oct 2024
- 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors28 Nov 2023
- 2023Deep-learning-based decomposition of overlapping-sparse images: application at the vertex of neutrino interactions30 Oct 2023
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models27 Oct 2023
- 2023Learning to Simulate Tree-Branch Dynamics for Manipulation6 Jun 2023
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfer9 Feb 2023
- 2022Latent Neural ODEs with Sparse Bayesian Multiple Shooting7 Oct 2022
- 2022Real2Sim2Real Transfer for Control of Cable-driven Robots via a Differentiable Physics Engine13 Sep 2022
12 newest of 15 All 15 (JSON)