mlsanityData to 14 Oct 2026

Human-Robot Mutual Learning through Affective-Linguistic Interaction and Differential Outcomes Training [Pre-Print]

arXiv 2407.01280 ↗First posted 1 Jul 2024cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Owing to the recent success of Large Language Models, Modern A.I has been much focused on linguistic interactions with humans but less focused on non-linguistic forms of communication between man and machine. In the present paper, we test how affective-linguistic communication, in combination with differential outcomes training, affects mutual learning in a human-robot context. Taking inspiration from child-caregiver dynamics, our human-robot interaction setup consists of a (simulated) robot attempting to learn how best to communicate internal, homeostatically-controlled needs; while a human "caregiver" attempts to learn the correct object to satisfy the robot's present communicated need. We studied the effects of i) human training type, and ii) robot reinforcement learning type, to assess mutual learning terminal accuracy and rate of learning (as measured by the average reward achieved by the robot). Our results find mutual learning between a human and a robot is significantly improved with Differential Outcomes Training (DOT) compared to Non-DOT (control) conditions. We find further improvements when the robot uses an exploration-exploitation policy selection, compared to purely exploitation policy selection. These findings have implications for utilizing socially assistive robots (SAR) in therapeutic contexts, e.g. for cognitive interventions, and educational applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 33 references that are in the map. First posted on arXiv 1 Jul 2024.

Builds on

2 of 33 references.

References · 2

  1. 2023A Human-Robot Mutual Learning System with Affect-Grounded Language Acquisition and Differential Outcomes Trainingcited by 3
  2. 2024Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mind
  2. 2024Efficient Language-instructed Skill Acquisition via Reward-Policy Co-Evolution
  3. 2024Rethinking Mutual Information for Language Conditioned Skill Discovery on Imitation Learning
  4. 2025REALM: Real-Time Estimates of Assistance for Learned Models in Human-Robot Interaction
  5. 2024Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration
  6. 2024Yell At Your Robot: Improving On-the-Fly from Language Corrections
  7. 2020Learning Rewards from Linguistic Feedback
  8. 2024Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics