Generative Expressive Robot Behaviors using Large Language Models
Not on the map. Why?
Abstract (arXiv)
People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jan 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 9; 2025: 8; 2026: 5.
22 papers.
Sort:
By area:
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robotscited by 16
- 2024To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactionscited by 10
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contextscited by 9
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Roboticscited by 8
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learningcited by 6
- 2024Normative Modules: A Generative Agent Architecture for Learning Norms that Supports Multi-Agent Cooperationcited by 4
- 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewardscited by 4
- 2024Foundation Models for Autonomous Robots in Unstructured Environmentscited by 3
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approachcited by 3
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Reviewcited by 3
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feedingcited by 2
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Modelscited by 2
10 more
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperationcited by 2
- 2025Efficiently Generating Expressive Quadruped Behaviors via Language-Guided Preference Learningcited by 1
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communicationcited by 1
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Modelscited by 1
- 2025SIL: Symbiotic Interactive Learning for Language-Conditioned Human-Agent Co-Adaptationcited by 1
- 2026The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanningcited by 1
- 2026ELLA: Generative AI-Powered Social Robots for Early Language Development at Homecited by 0
- 2026Towards Considerate Human-Robot Coexistence: A Dual-Space Framework of Robot Design and Human Perception in Healthcarecited by 0
- 2026Learning Transferable Latent User Preferences for Human-Aligned Decision Makingcited by 0
- 2026Generating Natural and Expressive Robot Gestures through Iterative Reinforcement Learning with Human Feedback using LLMscited by 0
- 2026Generating Natural and Expressive Robot Gestures through Iterative Reinforcement Learning with Human Feedback using LLMs17 Jun 2026
- 2026Learning Transferable Latent User Preferences for Human-Aligned Decision Making12 May 2026
- 2026Towards Considerate Human-Robot Coexistence: A Dual-Space Framework of Robot Design and Human Perception in Healthcare6 Apr 2026
- 2026The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning20 Mar 2026
- 2026ELLA: Generative AI-Powered Social Robots for Early Language Development at Home12 Mar 2026
- 2025SIL: Symbiotic Interactive Learning for Language-Conditioned Human-Agent Co-Adaptation7 Nov 2025
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models17 Jun 2025
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review26 May 2025
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication15 Feb 2025
- 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards12 Feb 2025
- 2025Efficiently Generating Expressive Quadruped Behaviors via Language-Guided Preference Learning6 Feb 2025
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation15 Jan 2025
10 more
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Robotics27 Nov 2024
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning30 Oct 2024
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feeding27 Oct 2024
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approach23 Oct 2024
- 2024Foundation Models for Autonomous Robots in Unstructured Environments19 Jul 2024
- 2024Normative Modules: A Generative Agent Architecture for Learning Norms that Supports Multi-Agent Cooperation29 May 2024
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots5 Apr 2024
- 2024To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions19 Mar 2024
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts9 Mar 2024
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Roboticscited by 8
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Reviewcited by 3
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Modelscited by 1
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models17 Jun 2025
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review26 May 2025
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Robotics27 Nov 2024
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robotscited by 16
- 2024To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactionscited by 10
- 2024MATRIX: Multi-Agent Trajectory Generation with Diverse Contextscited by 9
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learningcited by 6
- 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewardscited by 4
- 2024Foundation Models for Autonomous Robots in Unstructured Environmentscited by 3
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approachcited by 3
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feedingcited by 2
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Modelscited by 2
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperationcited by 2
- 2025Efficiently Generating Expressive Quadruped Behaviors via Language-Guided Preference Learningcited by 1
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communicationcited by 1
12 most cited of 15 All 15 (JSON)
- 2026Towards Considerate Human-Robot Coexistence: A Dual-Space Framework of Robot Design and Human Perception in Healthcare6 Apr 2026
- 2026The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning20 Mar 2026
- 2026ELLA: Generative AI-Powered Social Robots for Early Language Development at Home12 Mar 2026
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication15 Feb 2025
- 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards12 Feb 2025
- 2025Efficiently Generating Expressive Quadruped Behaviors via Language-Guided Preference Learning6 Feb 2025
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation15 Jan 2025
- 2025Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models1 Jan 2025
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning30 Oct 2024
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feeding27 Oct 2024
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approach23 Oct 2024
- 2024Foundation Models for Autonomous Robots in Unstructured Environments19 Jul 2024
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026ExpressMM: Expressive Mobile Manipulation Behaviors in Human-Robot Interactions ↗
- 2025Interactive Expressive Motion Generation Using Dynamic Movement Primitives ↗
- 2022Interactive Language: Talking to Robots in Real Time
- 2025Hierarchical Intention-Aware Expressive Motion Generation for Humanoid Robots
- 2024Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?
- 2025Generation of Real-time Robotic Emotional Expressions Learning from Human Demonstration in Mixed Reality ↗
- 2025Bootstrapping Human-Like Planning via LLMs
- 2024EVOLVE: Emotion and Visual Output Learning via LLM Evaluation ↗