Does ChatGPT and Whisper Make Humanoid Robots More Relatable?
Not on the map. Why?
Abstract (arXiv)
Humanoid robots are designed to be relatable to humans for applications such as customer support and helpdesk services. However, many such systems, including Softbank's Pepper, fall short because they fail to communicate effectively with humans. The advent of Large Language Models (LLMs) shows the potential to solve the communication barrier for humanoid robotics. This paper outlines the comparison of different Automatic Speech Recognition (ASR) APIs, the integration of Whisper ASR and ChatGPT with the Pepper robot and the evaluation of the system (Pepper-GPT) tested by 15 human users. The comparison result shows that, compared to the Google ASR and Google Cloud ASR, the Whisper ASR performed best as its average Word Error Rate (1.716%) and processing time (2.639 s) are both the lowest. The participants' usability investigations show that 60% of the participants thought the performance of the Pepper-GPT was "excellent", while the rest rated this system as "good" in the subsequent experiments. It is proved that while some problems still need to be overcome, such as the robot's multilingual ability and facial tracking capacity, users generally responded positively to the system, feeling like talking to an actual human.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Feb 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whispercited by 12
- 2026Understanding Persuasive Interactions between Generative Social Agents and Humans: The Knowledge-based Persuasion Model (KPM)cited by 3
- 2026A Framework for Low-Latency, LLM-driven Multimodal Interaction on the Pepper Robotcited by 1
- 2026Understanding Persuasive Interactions between Generative Social Agents and Humans: The Knowledge-based Persuasion Model (KPM)12 Feb 2026
- 2026A Framework for Low-Latency, LLM-driven Multimodal Interaction on the Pepper Robot9 Jan 2026
- 2024Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whisper9 Jun 2024