Voice control interface for surgical robot assistants
Not on the map. Why?
Abstract (arXiv)
Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Sep 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planningcited by 4
- 2025Enhancing Speech Instruction Understanding and Disambiguation in Robotics via Speech Prosodycited by 1
- 2025Beyond Single Models: Enhancing LLM Detection of Ambiguity in Requests through Debatecited by 1
- 2025Voice-Interactive Surgical Agent for Multimodal Patient Data Controlcited by 0
- 2025Voice-Interactive Surgical Agent for Multimodal Patient Data Control10 Nov 2025
- 2025Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planning16 Jul 2025
- 2025Beyond Single Models: Enhancing LLM Detection of Ambiguity in Requests through Debate16 Jul 2025
- 2025Enhancing Speech Instruction Understanding and Disambiguation in Robotics via Speech Prosody1 Jun 2025