Energy
Conformal Prediction Sets for Instance Segmentation
Lu, Kerri, Kluger, Dan M., Bates, Stephen, Wang, Sherrie
Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground truth. To address this limitation, we introduce a conformal prediction algorithm to generate adaptive confidence sets for instance segmentation. Given an image and a pixel coordinate query, our algorithm generates a confidence set of instance predictions for that pixel, with a provable guarantee for the probability that at least one of the predictions has high Intersection-Over-Union (IoU) with the true object instance mask. We apply our algorithm to instance segmentation examples in agricultural field delineation, cell segmentation, and vehicle detection. Empirically, we find that our prediction sets vary in size based on query difficulty and attain the target coverage, outperforming existing baselines such as Learn Then Test, Conformal Risk Control, and morphological dilation-based methods. We provide versions of the algorithm with asymptotic and finite sample guarantees.
Appendix Table of Contents
Our datasets and code are available via the following links: Github: https://github.com/NREL/BuildingsBench As described in Sec. 3 and Sec. 4, Buildings-900K and the BuildingsBench benchmark datasets are B.1 Motivation Q: For what purpose was the dataset created? It specifically addresses a lack of appropriately sized and diverse datasets for pretraining STLF models. We emphasize that the EULP was not originally developed for studying STLF. Rather, it was developed as a general resource to "...help electric utilities, grid operators, manufacturers, Q: Who created the dataset (e.g., which team, research group) and on behalf of which entity Q: Who funded the creation of the dataset?