Real2Sim2Real Transfer for Control of Cable-driven Robots via a Differentiable Physics Engine
Not on the map. Why?
Abstract (arXiv)
Tensegrity robots, composed of rigid rods and flexible cables, exhibit high strength-to-weight ratios and significant deformations, which enable them to navigate unstructured terrains and survive harsh impacts. They are hard to control, however, due to high dimensionality, complex dynamics, and a coupled architecture. Physics-based simulation is a promising avenue for developing locomotion policies that can be transferred to real robots. Nevertheless, modeling tensegrity robots is a complex task due to a substantial sim2real gap. To address this issue, this paper describes a Real2Sim2Real (R2S2R) strategy for tensegrity robots. This strategy is based on a differentiable physics engine that can be trained given limited data from a real robot. These data include offline measurements of physical properties, such as mass and geometry for various robot components, and the observation of a trajectory using a random control policy. With the data from the real robot, the engine can be iteratively refined and used to discover locomotion policies that are directly transferable to the real robot. Beyond the R2S2R pipeline, key contributions of this work include computing non-zero gradients at contact points, a loss function for matching tensegrity locomotion gaits, and a trajectory segmentation technique that avoids conflicts in gradient evaluation during training. Multiple iterations of the R2S2R process are demonstrated and evaluated on a real 3-bar tensegrity robot.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 13 Sep 2022.
Builds on
25 of 60 references.
References · 25
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2019TossingBot: Learning to Throw Arbitrary Objects with Residual Physicscited by 131
- 2016A Differentiable Physics Engine for Deep Learning in Roboticscited by 107
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2019BayesSim: adaptive domain randomization via probabilistic inference for robotics simulatorscited by 78
- 2019Deep Drone Racing: From Simulation to Reality with Domain Randomizationcited by 63
- 2021DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cuttingcited by 62
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2022DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Toolscited by 44
- 2022Differentiable Simulation of Soft Multi-body Systemscited by 39
- 2021Planar Robot Casting with Real2Sim2Real Self-Supervised Learningcited by 38
- 2020Differentiable Molecular Simulations for Control and Learningcited by 25
13 more
- 2019Interactive Differentiable Simulationcited by 17
- 2021Probabilistic Inference of Simulation Parameters via Parallel Differentiable Simulationcited by 17
- 2018Quantifying the Reality Gap in Robotic Manipulation Taskscited by 14
- 2022Contact Points Discovery for Soft-Body Manipulations with Differentiable Physicscited by 14
- 2020A First Principles Approach for Data-Efficient System Identification of Spring-Rod Systems via Differentiable Physics Enginescited by 7
- 2020Sim2Sim Evaluation of a Novel Data-Efficient Differentiable Physics Engine for Tensegrity Robotscited by 5
- 2016Deep Reinforcement Learning for Tensegrity Robot Locomotioncited by 4
- 2021A Differentiable Newton-Euler Algorithm for Real-World Roboticscited by 4
- 2016A Bio-Inspired Tensegrity Manipulator with Multi-DOF, Structurally Compliant Jointscited by 2
- 2018Design, Simulation, and Testing of a Flexible Actuated Spine for Quadruped Robotscited by 2
- 2022A Recurrent Differentiable Engine for Modeling Tensegrity Robots Trainable with Low-Frequency Datacited by 2
- 2021GRiD: GPU-Accelerated Rigid Body Dynamics with Analytical Gradientscited by 1
- 2022Parameter Identification and Motion Control for Articulated Rigid Body Robots Using Differentiable Position-based Dynamicscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 3.
5 papers.
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2023GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policycited by 3
- 2025Bootstrapping Imitation Learning for Long-horizon Manipulation via Hierarchical Data Collection Spacecited by 3
- 2025Prof. Robot: Differentiable Robot Rendering Without Static and Self-Collisionscited by 2
- 2025Diff-MSM: Differentiable MusculoSkeletal Model for Simultaneous Identification of Human Muscle and Bone Parameterscited by 0
- 2025Diff-MSM: Differentiable MusculoSkeletal Model for Simultaneous Identification of Human Muscle and Bone Parameters18 Aug 2025
- 2025Bootstrapping Imitation Learning for Long-horizon Manipulation via Hierarchical Data Collection Space23 May 2025
- 2025Prof. Robot: Differentiable Robot Rendering Without Static and Self-Collisions14 Mar 2025
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models27 Oct 2023
- 2023GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy16 Sep 2023