Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Deformable object manipulation (DOM) is challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multiple valid manipulation modes. We introduce Instant-Fold, an in-context imitation learning framework for DOM. Given a single human demonstration, our policy infers and executes diverse manipulation modes directly from the demonstration, including variations in spatial execution and ordering, without requiring gradient updates. Our approach first learns deformation-aware visual representations via temporal contrastive pretraining, after which a flow-matching transformer policy conditioned on the demonstration predicts actions to execute the intended manipulation mode. Trained entirely in simulation, Instant-Fold generalizes across diverse folding modes and transfers zero-shot to real-world settings without additional data collection or finetuning. Videos are available at https://instant-fold.github.io.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 46 of its 51 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
46 of 51 references.
Closest ancestors · 9
Same direction, newest first
- 2025Observer-Actor: Active Vision Imitation Learning with Sparse-View Gaussian Splatting22 Nov
- 20253D FlowMatch Actor: Unified 3D Policy for Single- and Dual-Arm Manipulation14 Aug
- 2025One-Shot Dual-Arm Imitation Learning10 Mar
- 2024Instant Policy: In-Context Imitation Learning via Graph Diffusion19 Nov
- 2024In-Context Imitation Learning via Next-Token Prediction28 Aug
- 2024One-Shot Imitation Learning with Invariance Matching for Robotic Manipulation21 May
- 2024Keypoint Action Tokens Enable In-Context Imitation Learning in Robotics28 Mar
- 2024DINOBot: Robot Manipulation via Retrieval and Alignment with Vision Foundation Models20 Feb
- 2023Few-Shot In-Context Imitation Learning via Implicit Graph Alignment18 Oct
Other references · 37
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Supervised Contrastive Learningcited by 2,803
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025DINOv3cited by 1,297
- 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2017One-Shot Imitation Learningcited by 232
25 more
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 118
- 2019CLOTH3D: Clothed 3D Humanscited by 114
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulationcited by 85
- 2021FlingBot: The Unreasonable Effectiveness of Dynamic Manipulation for Cloth Unfoldingcited by 80
- 2020Learning Predictive Representations for Deformable Objects Using Contrastive Estimationcited by 72
- 2021FabricFlowNet: Bimanual Cloth Manipulation with a Flow-based Policycited by 54
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulationcited by 52
- 2020VisuoSpatial Foresight for Multi-Step, Multi-Task Fabric Manipulationcited by 40
- 2022Cloth Funnels: Canonicalized-Alignment for Multi-Purpose Garment Manipulationcited by 28
- 2021Skeleton Merger: an Unsupervised Aligned Keypoint Detectorcited by 27
- 2020Latent Space Roadmap for Visual Action Planning of Deformable and Rigid Object Manipulationcited by 25
- 2022DaXBench: Benchmarking Deformable Object Manipulation with Differentiable Physicscited by 22
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 22
- 2024UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondencecited by 22
- 2025Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videoscited by 22
- 2021Learning Latent Graph Dynamics for Visual Manipulation of Deformable Objectscited by 17
- 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulationcited by 16
- 2023UniFolding: Towards Sample-efficient, Scalable, and Generalizable Robotic Garment Foldingcited by 13
- 2024Learning Keypoints for Robotic Cloth Manipulation using Synthetic Datacited by 11
- 2024Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identificationscited by 10
- 2024PianoMime: Learning a Generalist, Dexterous Piano Player from Internet Demonstrationscited by 8
- 2024AdaFold: Adapting Folding Trajectories of Cloths via Feedback-loop Manipulationcited by 6
- 2024General-purpose Clothes Manipulation with Semantic Keypointscited by 5
- 2025Reactive In-Air Clothing Manipulation with Confidence-Aware Dense Correspondence and Visuotactile Affordancecited by 4
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulationscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Learning Deformable Object Manipulation from Expert Demonstrations
- 2024Dynamic Manipulation of Deformable Objects using Imitation Learning with Adaptation to Hardware Constraints
- 2025Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy
- 2026Exploration-assisted Bottleneck Transition Toward Robust and Data-efficient Deformable Object Manipulation
- 2024DeformPAM: Data-Efficient Learning for Long-horizon Deformable Object Manipulation via Preference-based Action Alignment
- 2026Phase-Conditioned Imitation Learning with Autonomous Failure Recovery for Robust Deformable Object Manipulation
- 2023DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulation
- 2026RE4: Transformation-aware Imitation of Object Interactions Using Manipulation Modes