Goto

Collaborating Authors

 fregan


Algorithm1: Haarwavelettransformationpseudocode,PyTorch-like

Neural Information Processing Systems

D, demonstrating that our FreGAN is frequency-aware and can indeed produce realisticfrequencysignals. Broaderimpact. For HFD, we aggregate the high-frequency components by addingLH,HL,HH and then employ additional downsampling and convolutional layers tocompute the output scores. They are ideal for verifying the quality of the generation in low-shot scenarios. BrecaHAD9 dataset contains 162 images for breast cancer histopathological annotation and diagnosis. We evaluate the performance of our FreGAN and baseline models on more datasets with limited data amounts in Tab.1, namely, Medici, Temple, Bridge, and Wuzhen, all of which contain only 100 training images.



FreGAN: Exploiting Frequency Components for Training GANs under Limited Data

Neural Information Processing Systems

Training GANs under limited data often leads to discriminator overfitting and memorization issues, causing divergent training. Existing approaches mitigate the overfitting by employing data augmentations, model regularization, or attention mechanisms. However, they ignore the frequency bias of GANs and take poor consideration towards frequency information, especially high-frequency signals that contain rich details. To fully utilize the frequency information of limited data, this paper proposes FreGAN, which raises the model's frequency awareness and draws more attention to synthesising high-frequency signals, facilitating high-quality generation. In addition to exploiting both real and generated images' frequency information, we also involve the frequency signals of real images as a self-supervised constraint, which alleviates the GAN disequilibrium and encourages the generator to synthesis adequate rather than arbitrary frequency signals. Extensive results demonstrate the superiority and effectiveness of our FreGAN in ameliorating generation quality in the low-data regime (especially when training data is less than 100). Besides, FreGAN can be seamlessly applied to existing regularization and attention mechanism models to further boost the performance.




FreGAN: Exploiting Frequency Components for Training GANs under Limited Data

Neural Information Processing Systems

Training GANs under limited data often leads to discriminator overfitting and memorization issues, causing divergent training. Existing approaches mitigate the overfitting by employing data augmentations, model regularization, or attention mechanisms. However, they ignore the frequency bias of GANs and take poor consideration towards frequency information, especially high-frequency signals that contain rich details. To fully utilize the frequency information of limited data, this paper proposes FreGAN, which raises the model's frequency awareness and draws more attention to synthesising high-frequency signals, facilitating high-quality generation. In addition to exploiting both real and generated images' frequency information, we also involve the frequency signals of real images as a self-supervised constraint, which alleviates the GAN disequilibrium and encourages the generator to synthesis adequate rather than arbitrary frequency signals. Extensive results demonstrate the superiority and effectiveness of our FreGAN in ameliorating generation quality in the low-data regime (especially when training data is less than 100).