mlsanityData to 7 Oct 2026

Who's in Charge? Roles and Responsibilities of Decision-Making Components in Conversational Robots

arXiv 2303.08470 ↗First posted 15 Mar 2023cs.AI cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Software architectures for conversational robots typically consist of multiple modules, each designed for a particular processing task or functionality. Some of these modules are developed for the purpose of making decisions about the next action that the robot ought to perform in the current context. Those actions may relate to physical movements, such as driving forward or grasping an object, but may also correspond to communicative acts, such as asking a question to the human user. In this position paper, we reflect on the organization of those decision modules in human-robot interaction platforms. We discuss the relative benefits and limitations of modular vs. end-to-end architectures, and argue that, despite the increasing popularity of end-to-end approaches, modular architectures remain preferable when developing conversational robots designed to execute complex tasks in collaboration with human users. We also show that most practical HRI architectures tend to be either robot-centric or dialogue-centric, depending on where developers wish to place the ``command center'' of their system. While those design choices may be justified in some application domains, they also limit the robot's ability to flexibly interleave physical movements and conversational behaviours. We contend that architectures placing ``action managers'' and ``interaction managers'' on an equal footing may provide the best path forward for future human-robot interaction systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 64 references that are in the map. First posted on arXiv 15 Mar 2023.

Builds on

16 of 64 references.

References · 16

  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  3. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  4. 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
  5. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  6. 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
  7. 2020Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehiclescited by 101
  8. 2020Few-shot Natural Language Generation for Task-Oriented Dialogcited by 89
  9. 2019Dialog State Tracking: A Neural Reading Comprehension Approachcited by 62
  10. 2019Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systemscited by 52
  11. 2017Multimodal Probabilistic Model-Based Planning for Human-Robot Interactioncited by 50
  12. 2014Online Planning Algorithms for POMDPscited by 42
4 more
  1. 2022"Do you follow me?": A Survey of Recent Approaches in Dialogue State Trackingcited by 22
  2. 2018Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learningcited by 21
  3. 2022Multimodal Conversational AI: A Survey of Datasets and Approachescited by 16
  4. 2022Dialog Acts for Task-Driven Embodied Agentscited by 13

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.