Goto

Collaborating Authors

 continuous filter atom


Image Generation using Continuous Filter Atoms

Neural Information Processing Systems

In this paper, we model the subspace of convolutional filters with a neural ordinary differential equation (ODE) to enable gradual changes in generated images. Decomposing convolutional filters over a set of filter atoms allows efficiently modeling and sampling from a subspace of high-dimensional filters. By further modeling filters atoms with a neural ODE, we show both empirically and theoretically that such introduced continuity can be propagated to the generated images, and thus achieves gradually evolved image generation. We support the proposed framework of image generation with continuous filter atoms using various experiments, including image-to-image translation and image generation conditioned on continuous labels. Without auxiliary network components and heavy supervision, the proposed continuous filter atoms allow us to easily manipulate the gradual change of generated images by controlling integration intervals of neural ordinary differential equation. This research sheds the light on using the subspace of network parameters to navigate the diverse appearance of image generation.


Appendix A Proof of Theorem 2

Neural Information Processing Systems

Recall the operation in the i -th layer, i.e., the function F We introduce additional descriptions on the datasets with regression labels. All images are resized to 256x256 in both training and testing times. All images are resized to 256x256 in both training and testing times. Note that when training CycleGAN, only the first sub-group is adopted as a source domain, and the rest of the groups are all blended together as a target domain. For each population, we used 100 different cell images for training and testing.


Image Generation using Continuous Filter Atoms

Neural Information Processing Systems

In this paper, we model the subspace of convolutional filters with a neural ordinary differential equation (ODE) to enable gradual changes in generated images. Decomposing convolutional filters over a set of filter atoms allows efficiently modeling and sampling from a subspace of high-dimensional filters. By further modeling filters atoms with a neural ODE, we show both empirically and theoretically that such introduced continuity can be propagated to the generated images, and thus achieves gradually evolved image generation. We support the proposed framework of image generation with continuous filter atoms using various experiments, including image-to-image translation and image generation conditioned on continuous labels. Without auxiliary network components and heavy supervision, the proposed continuous filter atoms allow us to easily manipulate the gradual change of generated images by controlling integration intervals of neural ordinary differential equation.