Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Soft-bodied organisms such as octopuses and elephant trunks exhibit remarkable morphological adaptability, dynamically reconfiguring body shape and stiffness, and flexibly adjusting their control strategies to enable versatile behaviors. Inspired by these biological systems, various soft robots have emerged in recent decades, featuring diverse materials, stiffnesses, and morphologies tailored to specific tasks. Despite substantial advances in the materials and structural designs of soft robots, developing a generalizable control framework capable of rapid adaptation across diverse configurations remains a long-standing challenge. Existing controllers are limited to fixed configurations, demanding laborious configuration-specific remodelling and policy redesign for new configurations. Here, we introduce a generalizable control system that enables rapid adaptation across diverse soft robot configurations via reinforcement learning in a shared linear Koopman embedding space. By encoding robot dynamics into this embedding space, our method decouples control policies from specific morphologies, allowing real-time, model-free policy adaptation across diverse configurations without retraining from scratch. We validate our system across 33 distinct robot configurations. Our system achieves a 75 times reduction in transfer samples across configurations, while sustaining robust performance under high-speed motion, heavy payloads, and multiactuator faults, and achieving real-world skills previously unattainable in soft robotics. This work establishes a unified and adaptable control paradigm for diverse soft robot configurations, bridging mechanical reconfigurability with control flexibility, and may offer broader insights for generalizable control in complex physical systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 16 of its 58 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
16 of 58 references.
References · 16
- 2021Embodied Intelligence via Learning and Evolutioncited by 163
- 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
- 2017On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operatorcited by 73
- 2016Generalizing Koopman Theory to allow for inputs and controlcited by 53
- 2023Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Modelscited by 37
- 2019Active Learning of Dynamics for Data-Driven Control Using Koopman Operatorscited by 32
- 2021Soft Robots Modeling: a Structured Overviewcited by 19
- 2020Elastica: A compliant mechanics environment for soft robotic controlcited by 17
- 2020Derivative-Based Koopman Operators for Real-Time Control of Robotic Systemscited by 14
- 2020Learning Stable Models for Prediction and Controlcited by 12
- 2021Robust Tube-based Model Predictive Control with Koopman Operators--Extended Versioncited by 10
- 2017Discrete Cosserat Approach for Multi-Section Soft Robots Dynamicscited by 8
4 more
- 2023SpiRobs: Logarithmic Spiral-shaped Robots for Versatile Grasping Across Scalescited by 6
- 2020A soft robot that adapts to environments through shape changecited by 5
- 2020Koopman-based Control of a Soft Continuum Manipulator Under Variable Loading Conditionscited by 4
- 2022Topology and morphology design of spherically reconfigurable homogeneous Modular Soft Robots (MSoRos)cited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DittoGym: Learning to Control Soft Shape-Shifting Robots
- 2025Surrogate compliance modeling enables reinforcement learned locomotion gaits for soft robots ↗
- 2025Learning Soft Robotic Dynamics with Active Exploration
- 2024Reinforcement Learning Controllers for Soft Robots using Learned Environments
- 2025Natural Selection via Foundation Models for Soft Robot Evolution
- 2025McARL:Morphology-Control-Aware Reinforcement Learning for Generalizable Quadrupedal Locomotion
- 2025Accelerated co-design of robots through morphological pretraining
- 2026Rapid co-design of Buoyancy-assisted robots for Challenging Locomotion using Gaussian Evolutionary Specialists ↗