DRAPER: Towards a Robust Robot Deployment and Reliable Evaluation for Quasi-Static Pick-and-Place Cloth-Shaping Neural Controllers
Not on the map. Why?
Abstract (arXiv)
Comparing robotic cloth-manipulation systems in a real-world setup is challenging. The fidelity gap between simulation-trained cloth neural controllers and real-world operation hinders the reliable deployment of these methods in physical trials. Inconsistent experimental setups and hardware limitations among different approaches obstruct objective evaluations. This study demonstrates a reliable real-world comparison of different simulation-trained neural controllers on both flattening and folding tasks with different types of fabrics varying in material, size, and colour. We introduce the DRAPER framework to enable this comprehensive study, which reliably reflects the true capabilities of these neural controllers. It specifically addresses real-world grasping errors, such as misgrasping and multilayer grasping, through real-world adaptations of the simulation environment to provide data trajectories that closely reflect real-world grasping scenarios. It also employs a special set of vision processing techniques to close the simulation-to-reality gap in the perception. Furthermore, it achieves robust grasping by adopting a tweezer-extended gripper and a grasping procedure. We demonstrate DRAPER's generalisability across different deep-learning methods and robotic platforms, offering valuable insights to the cloth manipulation research community.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
22 of 25 references.
References · 22
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 384
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 121
10 more
- 2020Learning Predictive Representations for Deformable Objects Using Contrastive Estimationcited by 72
- 2021Learning Visible Connectivity Dynamics for Cloth Smoothingcited by 62
- 2021FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policycited by 54
- 2021LazyDAgger: Reducing Context Switching in Interactive Imitation Learningcited by 51
- 2019Deep Imitation Learning of Sequential Fabric Smoothing From an Algorithmic Supervisorcited by 44
- 2020A Modular Robotic Arm Control Stack for Research: Franka-Interface and FrankaPycited by 25
- 2020Learning Arbitrary-Goal Fabric Folding with One Hour of Real Robot Experiencecited by 24
- 2021VisuoSpatial Foresight for Physical Sequential Fabric Manipulationcited by 18
- 2023Foldsformer: Learning Sequential Multi-Step Cloth Manipulation With Space-Time Attentioncited by 10
- 2023PlaNet-ClothPick: Effective Fabric Flattening Based on Latent Dynamic Planningcited by 1
Built on by
Not cited yet.