Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions
Not on the map. Why?
Abstract (arXiv)
Robot-assisted dressing has the potential to significantly improve the lives of individuals with mobility impairments. To ensure an effective and comfortable dressing experience, the robot must be able to handle challenging deformable garments, apply appropriate forces, and adapt to limb movements throughout the dressing process. Prior work often makes simplifying assumptions -- such as static human limbs during dressing -- which limits real-world applicability. In this work, we develop a robot-assisted dressing system capable of handling partial observations with visual occlusions, as well as robustly adapting to arm motions during the dressing process. Given a policy trained in simulation with partial observations, we propose a method to fine-tune it in the real world using a small amount of data and multi-modal feedback from vision and force sensing, to further improve the policy's adaptability to arm motions and enhance safety. We evaluate our method in simulation with simplified articulated human meshes and in a real world human study with 12 participants across 264 dressing trials. Our policy successfully dresses two long-sleeve everyday garments onto the participants while being adaptive to various kinds of arm motions, and greatly outperforms prior baselines in terms of task completion and user feedback. Video are available at https://dressing-motion.github.io/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 16 Sep 2025.
Builds on
31 of 44 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2018Behavioral Cloning from Observationcited by 492
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2018Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Taskscited by 154
19 more
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 121
- 2019CLOTH3D: Clothed 3D Humanscited by 116
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 84
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 68
- 2023Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensingcited by 56
- 2019Assistive Gym: A Physics Simulation Framework for Assistive Roboticscited by 44
- 2022VIRDO: Visio-tactile Implicit Representations of Deformable Objectscited by 25
- 2022Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learningcited by 22
- 2024Real-World Offline Reinforcement Learning from Vision Language Model Feedbackcited by 22
- 2022Visuotactile Affordances for Cloth Manipulation with Local Controlcited by 21
- 2023One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garmentscited by 19
- 2019Learning to Collaborate from Simulation for Robot-Assisted Dressingcited by 16
- 2018Multi-Modal Geometric Learning for Grasping and Manipulationcited by 15
- 2020Simulation of Vision-based Tactile Sensors using Physics based Renderingcited by 15
- 2022Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feedingcited by 15
- 2017Deep Haptic Model Predictive Control for Robot-Assisted Dressingcited by 12
- 2023Force-Constrained Visual Policy: Safe Robot-Assisted Dressing via Multi-Modal Sensingcited by 10
- 2024ClothPPO: A Proximal Policy Optimization Enhancing Framework for Robotic Cloth Manipulation with Observation-Aligned Action Spacescited by 2
- 2024RoboCAP: Robotic Classification and Precision Pouring of Diverse Liquids and Granular Media with Capacitive Sensingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.