redrawing
Unsupervised Object Segmentation by Redrawing
Object segmentation is a crucial problem that is usually solved by using supervised learning approaches over very large datasets composed of both images and corresponding object masks. Since the masks have to be provided at pixel level, building such a dataset for any new domain can be very costly. We present ReDO, a new model able to extract objects from images without any annotation in an unsupervised way. It relies on the idea that it should be possible to change the textures or colors of the objects without changing the overall distribution of the dataset. Following this assumption, our approach is based on an adversarial architecture where the generator is guided by an input sample: given an image, it extracts the object mask, then redraws a new object at the same location. The generator is controlled by a discriminator that ensures that the distribution of generated images is aligned to the original one. We experiment with this method on different datasets and demonstrate the good quality of extracted masks.
Reviews: Unsupervised Object Segmentation by Redrawing
Originality: To my knowledge this is an original approach to the unsupervised learning of object segmentation. Besides the specific method proposed in this paper, I find this problem very exciting and I think that it will have a great development in the near future. I do not see this as a combination of prior work. In general, this paper uses methodologies/toola that are becoming well-established (eg GANs). There is a good prior work section, but some important works are missing and should be discussed, such as: Remez et al. SEIGAN: towards compositional image generation by simultaneously learning to segment, enhance, and inpaint, ArXiv 2018 Kanezaki.
Reviews: Unsupervised Object Segmentation by Redrawing
I thank the authors for their submission. The paper presents an algorithm for unsupervised object segmentation. I strongly encourage the authors to take into account the reviewers' comments and concerns for the final manuscript, in particular regarding failure points, weaknesses and directions for future work.
Unsupervised Object Segmentation by Redrawing
Object segmentation is a crucial problem that is usually solved by using supervised learning approaches over very large datasets composed of both images and corresponding object masks. Since the masks have to be provided at pixel level, building such a dataset for any new domain can be very costly. We present ReDO, a new model able to extract objects from images without any annotation in an unsupervised way. It relies on the idea that it should be possible to change the textures or colors of the objects without changing the overall distribution of the dataset. Following this assumption, our approach is based on an adversarial architecture where the generator is guided by an input sample: given an image, it extracts the object mask, then redraws a new object at the same location.
Unsupervised Object Segmentation by Redrawing
Chen, Mickaël, Artières, Thierry, Denoyer, Ludovic
Object segmentation is a crucial problem that is usually solved by using supervised learning approaches over very large datasets composed of both images and corresponding object masks. Since the masks have to be provided at pixel level, building such a dataset for any new domain can be very costly. We present ReDO, a new model able to extract objects from images without any annotation in an unsupervised way. It relies on the idea that it should be possible to change the textures or colors of the objects without changing the overall distribution of the dataset. Following this assumption, our approach is based on an adversarial architecture where the generator is guided by an input sample: given an image, it extracts the object mask, then redraws a new object at the same location. The generator is controlled by a discriminator that ensures that the distribution of generated images is aligned to the original one.