Challenges and Outlook in Robotic Manipulation of Deformable Objects
Not on the map. Why?
Abstract (arXiv)
Deformable object manipulation (DOM) is an emerging research problem in robotics. The ability to manipulate deformable objects endows robots with higher autonomy and promises new applications in the industrial, services, and healthcare sectors. However, compared to rigid object manipulation, the manipulation of deformable objects is considerably more complex, and is still an open research problem. Addressing DOM challenges demand breakthroughs in almost all aspects of robotics, namely hardware design, sensing, (deformation) modeling, planning, and control. In this article, we review recent advances and highlight the main challenges when considering deformation in each sub-field. A particular focus of our paper lies in the discussions of these challenges and proposing future directions of research.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 11; 2024: 6; 2025: 15; 2026: 9.
43 papers.
Sort:
By area:
- 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 51
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2025ManipBench: Benchmarking Vision-Language Models for Low-Level Robot Manipulationcited by 24
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 22
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Datacited by 11
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamicscited by 10
- 2023Neural Autoencoder-Based Structure-Preserving Model Order Reduction and Control Design for High-Dimensional Physical Systemscited by 7
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervisioncited by 7
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learningcited by 7
- 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulationcited by 6
- 2025InstructionBench: An Instructional Video Understanding Benchmarkcited by 5
- 2023DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objectscited by 4
31 more
- 2023DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objectscited by 4
- 2023A Systematic Literature Review of Computer Vision Applications in Robotized Wire Harness Assemblycited by 3
- 2023DefGoalNet: Contextual Goal Learning from Demonstrations For Deformable Object Manipulationcited by 3
- 2025GraphGarment: Learning Garment Dynamics for Bimanual Cloth Manipulation Taskscited by 3
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learningcited by 2
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulationscited by 2
- 2026Preference Aligned Visuomotor Diffusion Policies for Deformable Object Manipulationcited by 2
- 2026SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)cited by 2
- 2023Learning visual-based deformable object rearrangement with local graph neural networkscited by 1
- 2023Learning to bag with a simulation-free reinforcement learning framework for robotscited by 1
- 2023Make a Donut: Hierarchical EMD-Space Planning for Zero-Shot Deformable Manipulation with Toolscited by 1
- 2024Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objectscited by 1
- 2024Conditional Variational Auto Encoder Based Dynamic Motion for Multi-task Imitation Learningcited by 1
- 2024RaggeDi: Diffusion-based State Estimation of Disordered Rags, Sheets, Towels and Blanketscited by 1
- 2024SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulationcited by 1
- 2025DEFT: Differentiable Branched Discrete Elastic Rods for Modeling Furcated DLOs in Real-Timecited by 1
- 2025Sim2Real Transfer for Vision-Based Grasp Verificationcited by 1
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policycited by 1
- 2023Robotic Fabric Flattening with Wrinkle Direction Detectioncited by 0
- 2023Reinforcement Learning-Based Bionic Reflex Control for Anthropomorphic Robotic Grasping exploiting Domain Randomizationcited by 0
- 2025Acoustic Wave Manipulation Through Sparse Robotic Actuationcited by 0
- 2025Deformable Linear Object Surface Placement Using Elastica Planning and Local Shape Controlcited by 0
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulationcited by 0
- 2025Deformable Cluster Manipulation via Whole-Arm Policy Learningcited by 0
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Predictioncited by 0
- 2025Generalizing Shape-from-Template to Topological Changescited by 0
- 2026DefVINS: Visual-Inertial Odometry for Deformable Scenescited by 0
- 2026TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrationscited by 0
- 2026TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objectscited by 0
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracingcited by 0
- 2026Learning Sim-Grounded Policies for Bimanual Rope Manipulation from Human Teleoperation Datacited by 0
- 2026SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)5 Jul 2026
- 2026Learning Sim-Grounded Policies for Bimanual Rope Manipulation from Human Teleoperation Data15 May 2026
- 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation12 May 2026
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracing19 Mar 2026
- 2026TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects17 Mar 2026
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learning21 Feb 2026
- 2026TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations16 Feb 2026
- 2026Preference Aligned Visuomotor Diffusion Policies for Deformable Object Manipulation10 Feb 2026
- 2026DefVINS: Visual-Inertial Odometry for Deformable Scenes2 Jan 2026
- 2025Generalizing Shape-from-Template to Topological Changes5 Nov 2025
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policy13 Oct 2025
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Prediction7 Aug 2025
31 more
- 2025Deformable Cluster Manipulation via Whole-Arm Policy Learning22 Jul 2025
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2025ManipBench: Benchmarking Vision-Language Models for Low-Level Robot Manipulation14 May 2025
- 2025Sim2Real Transfer for Vision-Based Grasp Verification5 May 2025
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulations1 May 2025
- 2025InstructionBench: An Instructional Video Understanding Benchmark7 Apr 2025
- 2025Deformable Linear Object Surface Placement Using Elastica Planning and Local Shape Control11 Mar 2025
- 2025GraphGarment: Learning Garment Dynamics for Bimanual Cloth Manipulation Tasks4 Mar 2025
- 2025DEFT: Differentiable Branched Discrete Elastic Rods for Modeling Furcated DLOs in Real-Time20 Feb 2025
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learning17 Feb 2025
- 2025Acoustic Wave Manipulation Through Sparse Robotic Actuation12 Feb 2025
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervision3 Jan 2025
- 2024SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation26 Sep 2024
- 2024RaggeDi: Diffusion-based State Estimation of Disordered Rags, Sheets, Towels and Blankets18 Sep 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Conditional Variational Auto Encoder Based Dynamic Motion for Multi-task Imitation Learning24 May 2024
- 2024Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objects15 Mar 2024
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Data3 Jan 2024
- 2023DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objects23 Dec 2023
- 2023Neural Autoencoder-Based Structure-Preserving Model Order Reduction and Control Design for High-Dimensional Physical Systems11 Dec 2023
- 2023Reinforcement Learning-Based Bionic Reflex Control for Anthropomorphic Robotic Grasping exploiting Domain Randomization8 Dec 2023
- 2023Make a Donut: Hierarchical EMD-Space Planning for Zero-Shot Deformable Manipulation with Tools5 Nov 2023
- 2023Learning to bag with a simulation-free reinforcement learning framework for robots22 Oct 2023
- 2023Learning visual-based deformable object rearrangement with local graph neural networks16 Oct 2023
- 2023DefGoalNet: Contextual Goal Learning from Demonstrations For Deformable Object Manipulation25 Sep 2023
- 2023A Systematic Literature Review of Computer Vision Applications in Robotized Wire Harness Assembly24 Sep 2023
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment19 Aug 2023
- 2023DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objects8 May 2023
- 2023Robotic Fabric Flattening with Wrinkle Direction Detection8 Mar 2023
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamics19 Sep 2022
- 2022SpeedFolding: Learning Efficient Bimanual Folding of Garments22 Aug 2022
- 2026Preference Aligned Visuomotor Diffusion Policies for Deformable Object Manipulationcited by 2
- 2024RaggeDi: Diffusion-based State Estimation of Disordered Rags, Sheets, Towels and Blanketscited by 1
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulationcited by 0
- 2026Preference Aligned Visuomotor Diffusion Policies for Deformable Object Manipulation10 Feb 2026
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2024RaggeDi: Diffusion-based State Estimation of Disordered Rags, Sheets, Towels and Blankets18 Sep 2024
- 2024Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objectscited by 1
- 2024Conditional Variational Auto Encoder Based Dynamic Motion for Multi-task Imitation Learningcited by 1
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracingcited by 0
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracing19 Mar 2026
- 2024Conditional Variational Auto Encoder Based Dynamic Motion for Multi-task Imitation Learning24 May 2024
- 2024Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objects15 Mar 2024
- 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 51
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 22
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Datacited by 11
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamicscited by 10
- 2023Neural Autoencoder-Based Structure-Preserving Model Order Reduction and Control Design for High-Dimensional Physical Systemscited by 7
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervisioncited by 7
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learningcited by 7
- 2025InstructionBench: An Instructional Video Understanding Benchmarkcited by 5
- 2023DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objectscited by 4
- 2023DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objectscited by 4
- 2023A Systematic Literature Review of Computer Vision Applications in Robotized Wire Harness Assemblycited by 3
12 most cited of 34 All 34 (JSON)
- 2026SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)5 Jul 2026
- 2026Learning Sim-Grounded Policies for Bimanual Rope Manipulation from Human Teleoperation Data15 May 2026
- 2026TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects17 Mar 2026
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learning21 Feb 2026
- 2026TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations16 Feb 2026
- 2026DefVINS: Visual-Inertial Odometry for Deformable Scenes2 Jan 2026
- 2025Generalizing Shape-from-Template to Topological Changes5 Nov 2025
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policy13 Oct 2025
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Prediction7 Aug 2025
- 2025Deformable Cluster Manipulation via Whole-Arm Policy Learning22 Jul 2025
- 2025Sim2Real Transfer for Vision-Based Grasp Verification5 May 2025
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulations1 May 2025
12 newest of 34 All 34 (JSON)