SpeedFolding: Learning Efficient Bimanual Folding of Garments
Not on the map. Why?
Abstract (arXiv)
Folding garments reliably and efficiently is a long standing challenge in robotic manipulation due to the complex dynamics and high dimensional configuration space of garments. An intuitive approach is to initially manipulate the garment to a canonical smooth configuration before folding. In this work, we develop SpeedFolding, a reliable and efficient bimanual system, which given user-defined instructions as folding lines, manipulates an initially crumpled garment to (1) a smoothed and (2) a folded configuration. Our primary contribution is a novel neural network architecture that is able to predict pairs of gripper poses to parameterize a diverse set of bimanual action primitives. After learning from 4300 human-annotated and self-supervised actions, the robot is able to fold garments from a random initial configuration in under 120s on average with a success rate of 93%. Real-world experiments show that the system is able to generalize to unseen garments of different color, shape, and stiffness. While prior work achieved 3-6 Folds Per Hour (FPH), SpeedFolding achieves 30-40 FPH.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 22 Aug 2022.
Builds on
18 of 31 references.
References · 18
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
- 2018Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learningcited by 128
- 2021FlingBot: The Unreasonable Effectiveness of Dynamic Manipulation for Cloth Unfoldingcited by 81
- 2020Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networkscited by 78
- 2021FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policycited by 54
- 2019Deep Imitation Learning of Sequential Fabric Smoothing From an Algorithmic Supervisorcited by 44
- 2021Challenges and Outlook in Robotic Manipulation of Deformable Objectscited by 43
- 2020VisuoSpatial Foresight for Multi-Step, Multi-Task Fabric Manipulationcited by 40
- 2020Learning Arbitrary-Goal Fabric Folding with One Hour of Real Robot Experiencecited by 24
- 2020Self-supervised Learning for Precise Pick-and-place without Object Modelcited by 21
6 more
- 2020Untangling Dense Knots by Learning Task-Relevant Keypointscited by 21
- 2019Robot Learning of Shifting Objects for Grasping in Cluttered Environmentscited by 13
- 2022Efficiently Learning Single-Arm Fling Motions to Smooth Garmentscited by 8
- 2017A Certified-Complete Bimanual Manipulation Plannercited by 6
- 2018Robotic Sewing and Knot Tying for Personalized Stent Graft Manufacturingcited by 1
- 2021A Dual-arm Robot that Autonomously Lifts Up and Tumbles Heavy Plates Using Crane Pulley Blockscited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 19; 2025: 17; 2026: 7.
52 papers.
Sort:
By area:
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 176
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 39
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 23
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 23
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulationcited by 22
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusioncited by 21
- 2024VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulationcited by 21
- 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projectioncited by 19
- 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulationcited by 19
- 2023GarmentTracking: Category-Level Garment Pose Trackingcited by 16
- 2024AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulationcited by 16
38 more
- 2023UniFolding: Towards Sample-efficient, Scalable, and Generalizable Robotic Garment Foldingcited by 13
- 2025IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimationcited by 13
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Modelscited by 13
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Datacited by 11
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamicscited by 10
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervisioncited by 8
- 2022Learning Fabric Manipulation in the Real World with Human Videoscited by 7
- 2024DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignmentcited by 7
- 2025LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Languagecited by 7
- 2022SGTM 2.0: Autonomously Untangling Long Cables using Interactive Perceptioncited by 5
- 2023QDP: Learning to Sequentially Optimise Quasi-Static and Dynamic Manipulation Primitives for Robotic Cloth Manipulationcited by 5
- 2024LeTO: Learning Constrained Visuomotor Policy with Differentiable Trajectory Optimizationcited by 5
- 2024TieBot: Learning to Knot a Tie from Visual Demonstration through a Real-to-Sim-to-Real Approachcited by 5
- 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentationcited by 5
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulationcited by 5
- 2026SkillVLA: Tackling Combinatorial Diversity in Dual-Arm Manipulation via Skill Reusecited by 5
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisorscited by 4
- 2024PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Roboticscited by 4
- 2025BiFold: Bimanual Cloth Folding with Language Guidancecited by 4
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutterscited by 4
- 2024DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learningcited by 3
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learningcited by 3
- 2025One-Shot Affordance Grounding of Deformable Objects in Egocentric Organizing Scenescited by 3
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentationcited by 3
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Modelscited by 3
- 2024ClothPPO: A Proximal Policy Optimization Enhancing Framework for Robotic Cloth Manipulation with Observation-Aligned Action Spacescited by 2
- 2024Automating Deformable Gasket Assemblycited by 1
- 2024SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulationcited by 1
- 2024Flat'n'Fold: A Diverse Multi-Modal Dataset for Garment Perception and Manipulationcited by 1
- 2025FoldNet: Learning Generalizable Closed-Loop Policy for Garment Folding via Keypoint-Driven Asset and Demonstration Synthesiscited by 1
- 2025CLASP: General-Purpose Clothes Manipulation with Semantic Keypointscited by 1
- 2026PRISM: Performer RS-IMLE for Single-pass Multisensory Imitation Learningcited by 1
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoningcited by 1
- 2024AsymDex: Asymmetry and Relative Coordinates for RL-based Bimanual Dexteritycited by 0
- 2025SpikePingpong: Spike Vision-based Fast-Slow Pingpong Robot Systemcited by 0
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Predictioncited by 0
- 2026Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulationcited by 0
50 most cited of 52 All 52 (JSON)
- 2026Dynamic robotic cloth folding with efficient Koopman operator-based model predictive control18 May 2026
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models8 May 2026
- 2026Exploring 6D Object Pose Estimation with Deformation8 Apr 2026
- 2026Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulation7 Apr 2026
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoning4 Mar 2026
- 2026SkillVLA: Tackling Combinatorial Diversity in Dual-Arm Manipulation via Skill Reuse4 Mar 2026
- 2026PRISM: Performer RS-IMLE for Single-pass Multisensory Imitation Learning2 Feb 2026
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation14 Nov 2025
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models7 Nov 2025
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentation23 Sep 2025
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Prediction7 Aug 2025
- 2025CLASP: General-Purpose Clothes Manipulation with Semantic Keypoints26 Jul 2025
38 more
- 2025SpikePingpong: Spike Vision-based Fast-Slow Pingpong Robot System7 Jun 2025
- 2025FoldNet: Learning Generalizable Closed-Loop Policy for Garment Folding via Keypoint-Driven Asset and Demonstration Synthesis14 May 2025
- 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation8 May 2025
- 2025LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Language21 Mar 2025
- 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation15 Mar 2025
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulation12 Mar 2025
- 2025One-Shot Affordance Grounding of Deformable Objects in Egocentric Organizing Scenes3 Mar 2025
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutters24 Feb 2025
- 2025IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation17 Feb 2025
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learning17 Feb 2025
- 2025BiFold: Bimanual Cloth Folding with Language Guidance27 Jan 2025
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervision3 Jan 2025
- 2024AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulation9 Dec 2024
- 2024AsymDex: Asymmetry and Relative Coordinates for RL-based Bimanual Dexterity20 Nov 2024
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulation2 Nov 2024
- 2024DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning29 Oct 2024
- 2024DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignment15 Oct 2024
- 2024PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Robotics10 Oct 2024
- 2024Flat'n'Fold: A Diverse Multi-Modal Dataset for Garment Perception and Manipulation26 Sep 2024
- 2024SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation26 Sep 2024
- 2024Automating Deformable Gasket Assembly22 Aug 2024
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations8 Aug 2024
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes7 Aug 2024
- 2024VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulation4 Jul 2024
- 2024TieBot: Learning to Knot a Tie from Visual Demonstration through a Real-to-Sim-to-Real Approach3 Jul 2024
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondence11 May 2024
- 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projection6 May 2024
- 2024ClothPPO: A Proximal Policy Optimization Enhancing Framework for Robotic Cloth Manipulation with Observation-Aligned Action Spaces5 May 2024
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion25 Feb 2024
- 2024LeTO: Learning Constrained Visuomotor Policy with Differentiable Trajectory Optimization30 Jan 2024
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Data3 Jan 2024
- 2023UniFolding: Towards Sample-efficient, Scalable, and Generalizable Robotic Garment Folding2 Nov 2023
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulation3 Sep 2023
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment19 Aug 2023
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors27 Jun 2023
- 2023GarmentTracking: Category-Level Garment Pose Tracking24 Mar 2023
- 2023QDP: Learning to Sequentially Optimise Quasi-Static and Dynamic Manipulation Primitives for Robotic Cloth Manipulation23 Mar 2023
- 2022Learning Fabric Manipulation in the Real World with Human Videos5 Nov 2022
50 newest of 52 All 52 (JSON)
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 176
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulationcited by 22
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learningcited by 3
- 2024ClothPPO: A Proximal Policy Optimization Enhancing Framework for Robotic Cloth Manipulation with Observation-Aligned Action Spacescited by 2
- 2024AsymDex: Asymmetry and Relative Coordinates for RL-based Bimanual Dexteritycited by 0
- 2025Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learning17 Feb 2025
- 2024AsymDex: Asymmetry and Relative Coordinates for RL-based Bimanual Dexterity20 Nov 2024
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulation2 Nov 2024
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes7 Aug 2024
- 2024ClothPPO: A Proximal Policy Optimization Enhancing Framework for Robotic Cloth Manipulation with Observation-Aligned Action Spaces5 May 2024
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusioncited by 21
- 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulationcited by 19
- 2025IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimationcited by 13
- 2026PRISM: Performer RS-IMLE for Single-pass Multisensory Imitation Learningcited by 1
- 2026PRISM: Performer RS-IMLE for Single-pass Multisensory Imitation Learning2 Feb 2026
- 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation15 Mar 2025
- 2025IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation17 Feb 2025
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion25 Feb 2024
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentationcited by 5
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisorscited by 4
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentationcited by 3
- 2025ROPA: Synthetic Robot Pose Generation for RGB-D Bimanual Data Augmentation23 Sep 2025
- 2025D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation8 May 2025
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations8 Aug 2024
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors27 Jun 2023
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Modelscited by 13
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulationcited by 5
- 2026SkillVLA: Tackling Combinatorial Diversity in Dual-Arm Manipulation via Skill Reusecited by 5
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Modelscited by 3
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models8 May 2026
- 2026SkillVLA: Tackling Combinatorial Diversity in Dual-Arm Manipulation via Skill Reuse4 Mar 2026
- 2025Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation14 Nov 2025
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models7 Nov 2025
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 39
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 23
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 23
- 2024VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulationcited by 21
- 2024ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projectioncited by 19
- 2023GarmentTracking: Category-Level Garment Pose Trackingcited by 16
- 2024AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulationcited by 16
- 2023UniFolding: Towards Sample-efficient, Scalable, and Generalizable Robotic Garment Foldingcited by 13
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Datacited by 11
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamicscited by 10
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
- 2025Cloth-Splatting: 3D Cloth State Estimation from RGB Supervisioncited by 8
12 most cited of 33 All 33 (JSON)
- 2026Dynamic robotic cloth folding with efficient Koopman operator-based model predictive control18 May 2026
- 2026Exploring 6D Object Pose Estimation with Deformation8 Apr 2026
- 2026Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulation7 Apr 2026
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoning4 Mar 2026
- 2025FCBV-Net: Category-Level Robotic Garment Smoothing via Feature-Conditioned Bimanual Value Prediction7 Aug 2025
- 2025CLASP: General-Purpose Clothes Manipulation with Semantic Keypoints26 Jul 2025
- 2025SpikePingpong: Spike Vision-based Fast-Slow Pingpong Robot System7 Jun 2025
- 2025FoldNet: Learning Generalizable Closed-Loop Policy for Garment Folding via Keypoint-Driven Asset and Demonstration Synthesis14 May 2025
- 2025LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Language21 Mar 2025
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulation12 Mar 2025
- 2025One-Shot Affordance Grounding of Deformable Objects in Egocentric Organizing Scenes3 Mar 2025
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutters24 Feb 2025
12 newest of 33 All 33 (JSON)