Voice control interface for surgical robot assistants
Davila, Ana, Colan, Jacinto, Hasegawa, Yasuhisa
–arXiv.org Artificial Intelligence
Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.
arXiv.org Artificial Intelligence
Sep-16-2024
- Genre:
- Research Report > New Finding (0.48)
- Industry:
- Health & Medicine
- Surgery (1.00)
- Diagnostic Medicine > Imaging (0.46)
- Health & Medicine
- Technology:
- Information Technology > Artificial Intelligence
- Speech > Speech Recognition (1.00)
- Robots (1.00)
- Machine Learning > Neural Networks
- Deep Learning (0.46)
- Information Technology > Artificial Intelligence