Learning to Fold: prizewinning solution at LeHome Challenge 2026 (1st place online, 2nd offline)
Not on the map. Why?
Abstract (arXiv)
I describe my solution to the LeHome Challenge 2026, an ICRA 2026 competition on bimanual garment folding. The system placed 1st of 62 teams in the online (simulation) round and 2nd in the real-world final. It improves a vision-language-action (VLA) policy with a reinforcement-learning loop. The policy is its own value function: the same network that predicts actions also predicts success, progress, and a few task-relevant future quantities, and those predictions drive advantage estimation, live failure detection, and candidate selection. The work mostly recombines existing RL ideas with engineering and optimization contributions that can be used together as one recipe or individually: AWR + RECAP combined for flow-matching VLA; an asynchronous distributed training / rollout pipeline through HuggingFace Hub; inference-time hyperparameters optimization via Thompson sampling; a sim-to-real recipe with camera-alignment tooling, heavy augmentation and DAgger-like HIL data collection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
18 of 33 references.
References · 18
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2017A Tutorial on Thompson Samplingcited by 433
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
6 more
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 129
- 2025Improving Data Efficiency for LLM Reinforcement Fine-tuning Through Difficulty-targeted Online Data Selection and Rollout Replaycited by 56
- 2025Task adaptation of Vision-Language-Action model: 1st Place Solution for the 2025 BEHAVIOR Challengecited by 15
- 2026Exclusive Self Attentioncited by 6
- 2026NVIDIA Isaac Sim: Enabling Scalable, GPU-Accelerated Simulation for Roboticscited by 5
- 2026LeHome: A Simulation Environment for Deformable Object Manipulation in Household Scenarioscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025BiFold: Bimanual Cloth Folding with Language Guidance
- 2025FoldNet: Learning Generalizable Closed-Loop Policy for Garment Folding via Keypoint-Driven Asset and Demonstration Synthesis
- 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agent
- 2026DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation
- 2025EVOLVE-VLA: Test-Time Training from Environment Feedback for Vision-Language-Action Models
- 2025Beyond Static Perception: Integrating Temporal Context into VLMs for Cloth Folding
- 2025TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
- 2026π0-EqM: Equilibrium Matching for Closed-Loop Vision-Language-Action Control