Towards Robotic Feeding: Role of Haptics in Fork-based Food Manipulation
Not on the map. Why?
Abstract (arXiv)
Autonomous feeding is challenging because it requires manipulation of food items with various compliance, sizes, and shapes. To understand how humans manipulate food items during feeding and to explore ways to adapt their strategies to robots, we collected a rich dataset of human trajectories by asking them to pick up food and feed it to a mannequin. From the analysis of the collected haptic and motion signals, we demonstrate that humans adapt their control policies to accommodate to the compliance and shape of the food item being acquired. We propose a taxonomy of manipulation strategies for feeding to highlight such policies. As a first step to generate compliance-dependent policies, we propose a set of classifiers for compliance-based food categorization from haptic and motion signals. We compare these human manipulation strategies with fixed position-control policies via a robot. Our analysis of success and failure cases of human and robot policies further highlights the importance of adapting the policy to the compliance of a food item.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 3; 2024: 3; 2025: 0; 2026: 2.
16 papers.
Sort:
By area:
- 2022Learning Bimanual Scooping Policies for Food Acquisitioncited by 19
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2021Co-GAIL: Learning Diverse Strategies for Human-Robot Collaborationcited by 16
- 2022Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feedingcited by 15
- 2024Point Cloud Models Improve Visual Robustness in Robotic Learnerscited by 13
- 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Typescited by 8
- 2021User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environmentscited by 7
- 2022Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groupscited by 5
- 2023Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representationcited by 5
- 2021Extended Tactile Perception: Vibration Sensing through Tools and Grasped Objectscited by 4
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feedingcited by 2
- 2021Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstrationcited by 1
4 more
- 2023Learning Multimodal Attention for Manipulating Deformable Objects with Changing Statescited by 1
- 2023"Do it my way!": Impact of Customizations on Trust perceptions in Human-Robot Collaborationcited by 1
- 2026Robot-Assisted Social Dining as a White Glove Servicecited by 0
- 2026TacSushi: Tactile-Grounded World-Action Modeling for Dexterous Sushi Manipulationcited by 0
- 2026TacSushi: Tactile-Grounded World-Action Modeling for Dexterous Sushi Manipulation17 Sep 2026
- 2026Robot-Assisted Social Dining as a White Glove Service17 Feb 2026
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feeding13 Oct 2024
- 2024Point Cloud Models Improve Visual Robustness in Robotic Learners29 Apr 2024
- 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Types19 Mar 2024
- 2023"Do it my way!": Impact of Customizations on Trust perceptions in Human-Robot Collaboration28 Oct 2023
- 2023Learning Multimodal Attention for Manipulating Deformable Objects with Changing States26 Sep 2023
- 2023Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representation8 Sep 2023
- 2022Learning Bimanual Scooping Policies for Food Acquisition26 Nov 2022
- 2022Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feeding26 Nov 2022
- 2022Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groups7 Jul 2022
- 2021Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstration8 Oct 2021
4 more
- 2021Co-GAIL: Learning Diverse Strategies for Human-Robot Collaboration13 Aug 2021
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks26 Jun 2021
- 2021Extended Tactile Perception: Vibration Sensing through Tools and Grasped Objects1 Jun 2021
- 2021User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environments30 Mar 2021
- 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Typescited by 8
- 2021User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environmentscited by 7
- 2021Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstrationcited by 1
- 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Types19 Mar 2024
- 2021Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstration8 Oct 2021
- 2021User profile-driven large-scale multi-agent learning from demonstration in federated human-robot collaborative environments30 Mar 2021
- 2022Learning Bimanual Scooping Policies for Food Acquisitioncited by 19
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2021Co-GAIL: Learning Diverse Strategies for Human-Robot Collaborationcited by 16
- 2022Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feedingcited by 15
- 2024Point Cloud Models Improve Visual Robustness in Robotic Learnerscited by 13
- 2022Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groupscited by 5
- 2023Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representationcited by 5
- 2021Extended Tactile Perception: Vibration Sensing through Tools and Grasped Objectscited by 4
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feedingcited by 2
- 2023Learning Multimodal Attention for Manipulating Deformable Objects with Changing Statescited by 1
- 2023"Do it my way!": Impact of Customizations on Trust perceptions in Human-Robot Collaborationcited by 1
- 2026Robot-Assisted Social Dining as a White Glove Servicecited by 0
- 2026Robot-Assisted Social Dining as a White Glove Service17 Feb 2026
- 2024REPeat: A Real2Sim2Real Approach for Pre-acquisition of Soft Food Items in Robot-assisted Feeding13 Oct 2024
- 2024Point Cloud Models Improve Visual Robustness in Robotic Learners29 Apr 2024
- 2023"Do it my way!": Impact of Customizations on Trust perceptions in Human-Robot Collaboration28 Oct 2023
- 2023Learning Multimodal Attention for Manipulating Deformable Objects with Changing States26 Sep 2023
- 2023Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representation8 Sep 2023
- 2022Learning Bimanual Scooping Policies for Food Acquisition26 Nov 2022
- 2022Learning Visuo-Haptic Skewering Strategies for Robot-Assisted Feeding26 Nov 2022
- 2022Human-Robot Commensality: Bite Timing Prediction for Robot-Assisted Feeding in Groups7 Jul 2022
- 2021Co-GAIL: Learning Diverse Strategies for Human-Robot Collaboration13 Aug 2021
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks26 Jun 2021
- 2021Extended Tactile Perception: Vibration Sensing through Tools and Grasped Objects1 Jun 2021