Foreground Clustering for Joint Segmentation and Localization in Videos and Images

Our key idea is as follows: If an object localization classifier considers some bounding box to be a background, this, in principle, should enforce the segmentation classifier that superpixels in this bounding box are more likely to be background and vice-versa.