Augmenting Physical Simulators with Stochastic Neural Networks: Case Study of Planar Pushing and Bouncing
Not on the map. Why?
Abstract (arXiv)
An efficient, generalizable physical simulator with universal uncertainty estimates has wide applications in robot state estimation, planning, and control. In this paper, we build such a simulator for two scenarios, planar pushing and ball bouncing, by augmenting an analytical rigid-body simulator with a neural network that learns to model uncertainty as residuals. Combining symbolic, deterministic simulators with learnable, stochastic neural nets provides us with expressiveness, efficiency, and generalizability simultaneously. Our model outperforms both purely analytical and purely learned simulators consistently on real, standard benchmarks. Compared with methods that model uncertainty using Gaussian processes, our model runs much faster, generalizes better to new object shapes, and is able to characterize the complex distribution of object trajectories.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 2; 2023: 6; 2024: 10; 2025: 5; 2026: 5.
36 papers.
Sort:
By area:
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 80
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2022Learning rigid dynamics with face interaction graph networkscited by 43
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
- 2021Residual Reinforcement Learning from Demonstrationscited by 27
- 2021KNODE-MPC: A Knowledge-based Data-driven Predictive Control Framework for Aerial Robotscited by 26
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 22
- 2023Learning 3D Particle-based Simulators from RGB-D Videoscited by 17
- 2021SAGCI-System: Towards Sample-Efficient, Generalizable, Compositional, and Incremental Robot Learningcited by 16
- 2022Max-Min Off-Policy Actor-Critic Method Focusing on Worst-Case Robustness to Model Misspecificationcited by 11
24 more
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detectioncited by 10
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfercited by 10
- 2024ElastoGen: 4D Generative Elastodynamicscited by 10
- 2025Closing the Train-Test Gap in World Models for Gradient-Based Planningcited by 10
- 2023ArrayBot: Reinforcement Learning for Generalizable Distributed Manipulation through Touchcited by 9
- 2025Neural Robot Dynamicscited by 7
- 2024Generalizing Cooperative Eco-driving via Multi-residual Task Learningcited by 5
- 2023Residual Physics Learning and System Identification for Sim-to-real Transfer of Policies on Buoyancy Assisted Legged Robotscited by 4
- 2023PeRP: Personalized Residual Policies For Congestion Mitigation Through Co-operative Advisory Systemscited by 4
- 2024Precision-Focused Reinforcement Learning Model for Robotic Object Pushingcited by 3
- 2021An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learningcited by 2
- 2024Physics-Informed Model and Hybrid Planning for Efficient Dyna-Style Reinforcement Learningcited by 2
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulationcited by 2
- 2021Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Datacited by 1
- 2023Zero-shot Sim2Real Adaptation Across Environmentscited by 1
- 2023Neural Partial Differential Equations with Functional Convolutioncited by 1
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencodercited by 1
- 2024Cooperative Advisory Residual Policies for Congestion Mitigationcited by 1
- 2024Physics Encoded Blocks in Residual Neural Network Architectures for Digital Twin Modelscited by 1
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
- 2025ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulationcited by 0
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimationcited by 0
- 2026NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perceptioncited by 0
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptationcited by 0
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perception13 Jul 2026
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimation6 Feb 2026
- 2025Closing the Train-Test Gap in World Models for Gradient-Based Planning10 Dec 2025
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practices23 Oct 2025
- 2025Neural Robot Dynamics21 Aug 2025
- 2025ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulation5 Jun 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024Physics Encoded Blocks in Residual Neural Network Architectures for Digital Twin Models18 Nov 2024
- 2024Precision-Focused Reinforcement Learning Model for Robotic Object Pushing13 Nov 2024
24 more
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation27 Sep 2024
- 2024From Imitation to Refinement -- Residual RL for Precise Assembly23 Jul 2024
- 2024Physics-Informed Model and Hybrid Planning for Efficient Dyna-Style Reinforcement Learning2 Jul 2024
- 2024Cooperative Advisory Residual Policies for Congestion Mitigation30 Jun 2024
- 2024ElastoGen: 4D Generative Elastodynamics23 May 2024
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder18 Apr 2024
- 2024QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer11 Apr 2024
- 2024Generalizing Cooperative Eco-driving via Multi-residual Task Learning7 Mar 2024
- 2023Learning 3D Particle-based Simulators from RGB-D Videos8 Dec 2023
- 2023PeRP: Personalized Residual Policies For Congestion Mitigation Through Co-operative Advisory Systems1 Aug 2023
- 2023ArrayBot: Reinforcement Learning for Generalizable Distributed Manipulation through Touch29 Jun 2023
- 2023Residual Physics Learning and System Identification for Sim-to-real Transfer of Policies on Buoyancy Assisted Legged Robots16 Mar 2023
- 2023Neural Partial Differential Equations with Functional Convolution10 Mar 2023
- 2023Zero-shot Sim2Real Adaptation Across Environments8 Feb 2023
- 2022Learning rigid dynamics with face interaction graph networks7 Dec 2022
- 2022Max-Min Off-Policy Actor-Critic Method Focusing on Worst-Case Robustness to Model Misspecification7 Nov 2022
- 2021SAGCI-System: Towards Sample-Efficient, Generalizable, Compositional, and Incremental Robot Learning29 Nov 2021
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligence28 Oct 2021
- 2021Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Data2 Oct 2021
- 2021KNODE-MPC: A Knowledge-based Data-driven Predictive Control Framework for Aerial Robots10 Sep 2021
- 2021An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learning2 Aug 2021
- 2021Residual Reinforcement Learning from Demonstrations15 Jun 2021
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detection31 May 2021
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling25 Feb 2021
- 2021Residual Reinforcement Learning from Demonstrationscited by 27
- 2021Residual Reinforcement Learning from Demonstrations15 Jun 2021
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
- 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 80
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2022Learning rigid dynamics with face interaction graph networkscited by 43
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
- 2021KNODE-MPC: A Knowledge-based Data-driven Predictive Control Framework for Aerial Robotscited by 26
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 22
- 2023Learning 3D Particle-based Simulators from RGB-D Videoscited by 17
- 2021SAGCI-System: Towards Sample-Efficient, Generalizable, Compositional, and Incremental Robot Learningcited by 16
- 2022Max-Min Off-Policy Actor-Critic Method Focusing on Worst-Case Robustness to Model Misspecificationcited by 11
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detectioncited by 10
12 most cited of 32 All 32 (JSON)
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perception13 Jul 2026
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimation6 Feb 2026
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practices23 Oct 2025
- 2025Neural Robot Dynamics21 Aug 2025
- 2025ActivePusher: Active Learning and Planning with Residual Physics for Nonprehensile Manipulation5 Jun 2025
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills3 Feb 2025
- 2024Physics Encoded Blocks in Residual Neural Network Architectures for Digital Twin Models18 Nov 2024
- 2024Precision-Focused Reinforcement Learning Model for Robotic Object Pushing13 Nov 2024
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation27 Sep 2024
- 2024From Imitation to Refinement -- Residual RL for Precise Assembly23 Jul 2024
12 newest of 32 All 32 (JSON)