Deep Haptic Model Predictive Control for Robot-Assisted Dressing
Not on the map. Why?
Abstract (arXiv)
Robot-assisted dressing offers an opportunity to benefit the lives of many people with disabilities, such as some older adults. However, robots currently lack common sense about the physical implications of their actions on people. The physical implications of dressing are complicated by non-rigid garments, which can result in a robot indirectly applying high forces to a person's body. We present a deep recurrent model that, when given a proposed action by the robot, predicts the forces a garment will apply to a person's body. We also show that a robot can provide better dressing assistance by using this model with model predictive control. The predictions made by our model only use haptic and kinematic observations from the robot's end effector, which are readily attainable. Collecting training data from real world physical human-robot interaction can be time consuming, costly, and put people at risk. Instead, we train our predictive model using data collected in an entirely self-supervised fashion from a physics-based simulation. We evaluated our approach with a PR2 robot that attempted to pull a hospital gown onto the arms of 10 human participants. With a 0.2s prediction horizon, our controller succeeded at high rates and lowered applied force while navigating the garment around a persons fist and elbow without getting caught. Shorter prediction horizons resulted in significantly reduced performance with the sleeve catching on the participants' fists and elbows, demonstrating the value of our model's predictions. These behaviors of mitigating catches emerged from our deep predictive model and the controller objective function, which primarily penalizes high forces.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 3; 2022: 3; 2023: 2; 2024: 0; 2025: 1; 2026: 2.
12 papers.
- 2019Deep Imitation Learning of Sequential Fabric Smoothing From an Algorithmic Supervisorcited by 44
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Imagecited by 20
- 2021VisuoSpatial Foresight for Physical Sequential Fabric Manipulationcited by 18
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamicscited by 10
- 2022Learning Sampling Distributions for Model Predictive Controlcited by 10
- 2023Deep Model Predictive Optimizationcited by 7
- 2022Visual Haptic Reasoning: Estimating Contact Forces by Observing Deformable Object Interactionscited by 5
- 2023Safe Machine-Learning-supported Model Predictive Force and Motion Control in Roboticscited by 3
- 2025Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motionscited by 2
- 2021Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimationcited by 1
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusioncited by 1
- 2026Dressing in Motion: A Human Motion-Aware Diffusion Policy for Robot-Assisted Dressingcited by 0
- 2026Dressing in Motion: A Human Motion-Aware Diffusion Policy for Robot-Assisted Dressing4 Sep 2026
- 2026Customized Fusion: A Closed-Loop Dynamic Network for Adaptive Multi-Task-Aware Infrared-Visible Image Fusion10 Apr 2026
- 2025Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions16 Sep 2025
- 2023Deep Model Predictive Optimization6 Oct 2023
- 2023Safe Machine-Learning-supported Model Predictive Force and Motion Control in Robotics8 Mar 2023
- 2022Learning Sampling Distributions for Model Predictive Control5 Dec 2022
- 2022EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamics19 Sep 2022
- 2022Visual Haptic Reasoning: Estimating Contact Forces by Observing Deformable Object Interactions11 Aug 2022
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image20 May 2021
- 2021Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimation15 Mar 2021
- 2021VisuoSpatial Foresight for Physical Sequential Fabric Manipulation19 Feb 2021
- 2019Deep Imitation Learning of Sequential Fabric Smoothing From an Algorithmic Supervisor23 Sep 2019