AutoCam: Hierarchical Path Planning for an Autonomous Auxiliary Camera in Surgical Robotics
Banks, Alexandre, Moore, Randy, Zaman, Sayem Nazmuz, Abdelaal, Alaa Eldin, Salcudean, Septimiu E.
–arXiv.org Artificial Intelligence
--Incorporating an autonomous auxiliary camera into robot-assisted minimally invasive surgery (RAMIS) enhances spatial awareness and eliminates manual viewpoint control. Existing path planning methods for auxiliary cameras track two-dimensional surgical features but do not simultaneously account for camera orientation, workspace constraints, and robot joint limits. This study presents AutoCam: an automatic auxiliary camera placement method to improve visualization in RAMIS. Implemented on the da Vinci Research Kit, the system uses a priority-based, workspace-constrained control algorithm that combines heuristic geometric placement with nonlinear optimization to ensure robust camera tracking. A user study (N=6) demonstrated that the system maintained 99.84% visibility of a salient feature and achieved a pose error of 4.36 2.11 degrees and 1.95 5.66 mm. The controller was computationally efficient, with a loop time of 6.8 12.8 ms. An additional pilot study (N=6), where novices completed a Fundamentals of Laparoscopic Surgery training task, suggests that users can teleoperate just as effectively from AutoCam's viewpoint as from the endoscope's while still benefiting from AutoCam's improved visual coverage of the scene. These results indicate that an auxiliary camera can be autonomously controlled using the da Vinci patient-side manipulators to track a salient feature, laying the groundwork for new multi-camera visualization methods in RAMIS. OBOT assisted minimally invasive surgery (RAMIS) has been adopted in over 60 countries [1] and is shown to reduce postoperative blood loss, shorten hospitalization times, and enable tremor filtering and enhanced dexterity [2], [3]. Most surgical robots, including the da Vinci (Intuitive Surgical, Inc.) and Hugo (Medtronic, Inc.) systems, have a single endoscopic camera (ECM) restricted to rotate about the remote center of motion (RCM) at the incision site [4]. Having only one viewpoint with limited maneuverability compromises global awareness of the surgical scene [5] and impedes surgical workflow when the endoscope is occluded [4], [6], [7]. This work was supported by the NSERC Canada Graduate Scholarships, the NSERC Discovery Grant, and the C.A. Laszlo Biomedical Engineering Chair held by Professor Salcudean. A. Banks and R. Moore contributed equally to this work. Salcudean are with the University of British Columbia, V ancouver, BC V6T 1Z4, Canada. A. E. Abdelaal is with Stanford University, Stanford, CA 94305, United States.
arXiv.org Artificial Intelligence
May-16-2025
- Country:
- Africa > Middle East
- Egypt (0.04)
- Asia > Bangladesh
- Dhaka Division > Dhaka District > Dhaka (0.04)
- Europe
- Romania (0.04)
- Spain > Galicia
- Madrid (0.04)
- Switzerland (0.04)
- United Kingdom > England
- Oxfordshire > Oxford (0.04)
- North America
- Canada
- Alberta > Census Division No. 6
- Calgary Metropolitan Region > Calgary (0.04)
- British Columbia > Vancouver (0.24)
- New Brunswick
- Fredericton (0.04)
- Saint John County > Saint John (0.04)
- Quebec > Montreal (0.14)
- Alberta > Census Division No. 6
- United States
- California
- Los Angeles County > Los Angeles (0.14)
- Santa Clara County > Stanford (0.24)
- Massachusetts > Middlesex County
- Cambridge (0.04)
- California
- Canada
- Africa > Middle East
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Research Report
- Industry:
- Health & Medicine
- Diagnostic Medicine > Imaging (0.93)
- Health Care Technology (1.00)
- Surgery (1.00)
- Health & Medicine
- Technology: