Surgical instrument segmentation is instrumental to minimally invasive surgeries and related applications. Most previous methods formulate this task as single-frame-based instance segmentation while ignoring the natural temporal and stereo attributes of a surgical video. As a result, these methods are less robust against the appearance variation through temporal motion and view change. In this work, we propose a novel LACOSTE model that exploits Location-Agnostic COntexts in Stereo and TEmporal images for improved surgical instrument segmentation. Leveraging a query-based segmentation model as core, we design three performance-enhancing modules. Firstly, we design a disparity-guided feature propagation module to enhance depth-aware features explicitly. To generalize well for even only a monocular video, we apply a pseudo stereo scheme to generate complementary right images. Secondly, we propose a stereo-temporal set classifier, which aggregates stereo-temporal contexts in a universal way for making a consolidated prediction and mitigates transient failures. Finally, we propose a location-agnostic classifier to decouple the location bias from mask prediction and enhance the feature semantics. We extensively validate our approach on three public surgical video datasets, including two benchmarks from EndoVis Challenges and one real radical prostatectomy surgery dataset GraSP. Experimental results demonstrate the promising performances of our method, which consistently achieves comparable or favorable results with previous state-of-the-art approaches.

From streamlining marketing to improving customer service and building sales, the intelligent offerings of artificial intelligence (AI) and augmented reality (AR) technology are helping businesses engage with customers, follow up on leads, and maximize marketing opportunities. Take a look at three ways the most forward-thinking businesses in a broad range of industries are using AI and AR technologies to turn prospects into customers. Tech-savvy retailers and e-commerce e-tailers are incorporating augmented reality technology to enhance the customer experience. Given that 61% of consumers prefer stores which provide AR experiences, integrating AR technology is an effective way to improve customer experiences with your brand and turn prospects into customers. One example of a retailer effectively using AR to win over customers is Lacoste.