mlsanityData to 7 Oct 2026

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

arXiv 2401.03217 ↗First posted 6 Jan 2024cs.RO cs.HCcited by 43

Not on the map. Why?

Abstract (arXiv)

Large-language models (LLMs) hold significant promise in improving human-robot interaction, offering advanced conversational skills and versatility in managing diverse, open-ended user requests in various tasks and domains. Despite the potential to transform human-robot interaction, very little is known about the distinctive design requirements for utilizing LLMs in robots, which may differ from text and voice interaction and vary by task and context. To better understand these requirements, we conducted a user study (n = 32) comparing an LLM-powered social robot against text- and voice-based agents, analyzing task-based requirements in conversational tasks, including choose, generate, execute, and negotiate. Our findings show that LLM-powered robots elevate expectations for sophisticated non-verbal cues and excel in connection-building and deliberation, but fall short in logical communication and may induce anxiety. We provide design implications both for robots integrating LLMs and for fine-tuning LLMs for use with robots.

Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jan 2024.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 21; 2026: 13.

43 papers.

Sort:

By area:

  1. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  2. 2025TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Usecited by 46
  3. 2025Safety Guardrails for LLM-Enabled Robotscited by 30
  4. 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoningcited by 27
  5. 2024Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulationscited by 20
  6. 2024To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactionscited by 10
  7. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
  8. 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysiscited by 9
  9. 2025Multi-Agent Systems for Robotic Autonomy with LLMscited by 9
  10. 2025GroundingME: Exposing the Visual Grounding Gap in MLLMs through Multi-Dimensional Evaluationcited by 7
  11. 2024Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memorycited by 6
  12. 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learningcited by 6
31 more
  1. 2024HistNERo: Historical Named Entity Recognition for the Romanian Languagecited by 5
  2. 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
  3. 2025Detection Method for Prompt Injection by Integrating Pre-trained Model and Heuristic Feature Engineeringcited by 4
  4. 2026Understanding Persuasive Interactions between Generative Social Agents and Humans: The Knowledge-based Persuasion Model (KPM)cited by 3
  5. 2026A Spatio-Temporal Expert Prefetching Framework for Efficient MoE-based LLM Inferencecited by 3
  6. 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
  7. 2025Encoding Inequity: Examining Demographic Bias in LLM-Driven Robot Caregivingcited by 2
  8. 2025Agreeing to Interact in Human-Robot Interaction using Large Language Models and Vision Language Modelscited by 2
  9. 2025Building Knowledge from Interactions: An LLM-Based Architecture for Adaptive Tutoring and Social Reasoningcited by 2
  10. 2025Prediction-Powered Communication with Distortion Guaranteescited by 2
  11. 2024An Empirical Design Justice Approach to Identifying Ethical Considerations in the Intersection of Large Language Models and Social Roboticscited by 1
  12. 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communicationcited by 1
  13. 2025When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemmacited by 1
  14. 2025Plan-and-Act using Large Language Models for Interactive Agreementcited by 1
  15. 2025Comparing Self-Disclosure Themes and Semantics to a Human, a Robot, and a Disembodied Agentcited by 1
  16. 2025SEAL: Self-Evolving Agentic Learning for Conversational Question Answering over Knowledge Graphscited by 1
  17. 2026Knowledge-Based Design Requirements for Generative Social Robots in Higher Educationcited by 1
  18. 2026A ROS 2 Wrapper for Florence-2: Multi-Mode Local Vision-Language Inference for Robotic Systemscited by 1
  19. 2026CANINE: Coaching Visually Impaired Users for Interactive Navigation with a Robot Guide Dogcited by 1
  20. 2024Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?cited by 0
  21. 2025Word Synchronization Challenge: A Benchmark for Word Association Responses for Large Language Modelscited by 0
  22. 2025GenFT: A Generative Parameter-Efficient Fine-Tuning Method for Pretrained Foundation Modelscited by 0
  23. 2025Interpretable Robot Control via Structured Behavior Trees and Large Language Modelscited by 0
  24. 2025Intent-Driven LLM Ensemble Planning for Flexible Multi-Robot Disassembly: Demonstration on EV Batteriescited by 0
  25. 2026Botson: An Accessible and Low-Cost Platform for Social Robotics Researchcited by 0
  26. 2026Learning Transferable Latent User Preferences for Human-Aligned Decision Makingcited by 0
  27. 2026AI Snitches Get Glitches: Towards Evading Agentic Surveillancecited by 0
  28. 2026Autonomous VR-Based Risk Detection for Situational Awareness in Dangerous Settingscited by 0
  29. 2026Teachy Mini: Development and Preliminary Evaluation of a Knowledge-Based Generative Social Robot for Higher Educationcited by 0
  30. 2026Ludiscriptscriptstyle 0.1: An Agentic System for Socially Intelligent Robotscited by 0
  31. 2026Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRIcited by 0