mlsanityData to 7 Oct 2026

Intuitive Programming, Adaptive Task Planning, and Dynamic Role Allocation in Human-Robot Collaboration

arXiv 2511.08732 ↗First posted 11 Nov 2025cs.RO cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Remarkable capabilities have been achieved by robotics and AI, mastering complex tasks and environments. Yet, humans often remain passive observers, fascinated but uncertain how to engage. Robots, in turn, cannot reach their full potential in human-populated environments without effectively modeling human states and intentions and adapting their behavior. To achieve a synergistic human-robot collaboration (HRC), a continuous information flow should be established: humans must intuitively communicate instructions, share expertise, and express needs. In parallel, robots must clearly convey their internal state and forthcoming actions to keep users informed, comfortable, and in control. This review identifies and connects key components enabling intuitive information exchange and skill transfer between humans and robots. We examine the full interaction pipeline: from the human-to-robot communication bridge translating multimodal inputs into robot-understandable representations, through adaptive planning and role allocation, to the control layer and feedback mechanisms to close the loop. Finally, we highlight trends and promising directions toward more adaptive, accessible HRC.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 151 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

48 of 151 references.

References · 48

  1. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  2. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  3. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  4. 2023Language to Rewards for Robotic Skill Synthesiscited by 307
  5. 2020Integrated Task and Motion Planningcited by 281
  6. 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 194
  7. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
  8. 2017Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translationcited by 167
  9. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  10. 2021The Surprising Effectiveness of Representation Learning for Visual Imitationcited by 149
  11. 2019A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithmscited by 136
  12. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
36 more
  1. 2021Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videoscited by 116
  2. 2019AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videoscited by 105
  3. 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
  4. 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstrationcited by 76
  5. 2019Third-Person Visual Imitation Learning via Decoupled Hierarchical Controllercited by 73
  6. 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 60
  7. 2019Graph-Structured Visual Imitationcited by 43
  8. 2023Demo2Code: From Summarizing Demonstrations to Synthesizing Code via Extended Chain-of-Thoughtcited by 39
  9. 2018Trust-Aware Decision Making for Human-Robot Collaboration: Model Learning and Planningcited by 32
  10. 2023Thought Cloning: Learning to Think while Acting by Imitating Human Thinkingcited by 30
  11. 2019Learning Object-Action Relations from Bimanual Human Demonstration Using Graph Networkscited by 29
  12. 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigationcited by 27
  13. 2022K-VIL: Keypoints-based Visual Imitation Learningcited by 27
  14. 2016CoSTAR: Instructing Collaborative Robots with Behavior Trees and Visioncited by 20
  15. 2023Learning to Reason over Scene Graphs: A Case Study of Finetuning GPT-2 into a Robot Language Model for Grounded Task Planningcited by 16
  16. 2020A Hierarchical Architecture for Human-Robot Cooperation Processescited by 12
  17. 2023ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Spacecited by 11
  18. 2023Optimal task and motion planning and execution for human-robot multi-agent systems in dynamic environmentscited by 8
  19. 2018On the manipulation of articulated objects in human-robot cooperation scenarioscited by 7
  20. 2022Generalizable task representation learning from human demonstration videos: a geometric approachcited by 5
  21. 2023An Ergonomic Role Allocation Framework for Dynamic Human-Robot Collaborative Taskscited by 5
  22. 2023Interactive and Incremental Learning of Spatial Object Relations from Human Demonstrationscited by 5
  23. 2024Exploiting Information Theory for Intuitive Robot Programming of Manual Activitiescited by 4
  24. 2021A Human-Centered Dynamic Scheduling Architecture for Collaborative Applicationcited by 3
  25. 2021An Integrated Dynamic Method for Allocating Roles and Planning Tasks for Mixed Human-Robot Teamscited by 3
  26. 2022Pick the Right Co-Worker: Online Assessment of Cognitive Ergonomics in Human-Robot Collaborative Assemblycited by 3
  27. 2023Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detectioncited by 3
  28. 2024Learning Symbolic and Subsymbolic Temporal Task Constraints from Bimanual Human Demonstrationscited by 3
  29. 2025A Human-in-the-loop Approach to Robot Action Replanning through LLM Common-Sense Reasoningcited by 3
  30. 2019Joint Inference of Kinematic and Force Trajectories with Visuo-Tactile Sensingcited by 2
  31. 2022Gestural and Touchscreen Interaction for Human-Robot Collaboration: a Comparative Studycited by 2
  32. 2022A Task Allocation Framework for Human Multi-Robot Collaborative Settingscited by 2
  33. 2025RAIDER: Tool-Equipped Large Language Model Agent for Robotic Action Issue Detection, Explanation and Recoverycited by 2
  34. 2025Reactive and Safety-Aware Path Replanning for Collaborative Applicationscited by 1
  35. 2025A Laser-guided Interaction Interface for Providing Effective Robot Assistance to People with Upper Limbs Impairmentscited by 1
  36. 2025Mitigating Compensatory Movements in Prosthesis Users via Adaptive Collaborative Roboticscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Human-Aware Robot Behaviour in Self-Driving Labscited by 0