Text Promptable Surgical Instrument Segmentation with Vision-Language Models

Despite this recognised importance, existing automatic surgical instrument segmentation faces significant challenges. First, with fast-paced advances in MIS, there is a surge in the variety of surgical instruments from different vendors. This is however compounded with the lack of a comprehensive and large-scale dataset dedicated to the learning of surgical instrument segmentation.