DP-CGAN: Differentially Private Synthetic Data and Label Generation

Published in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops 2019DP-CGAN: Differentially Private Synthetic Data and Label Generation Reihaneh Torkzadehmahani University of California, Santa Cruz rtorkzad@ucsc.edu January 28, 2020 Abstract Generative Adversarial Networks (GANs) are one of the well-known models to generate synthetic data including images, especially for research communities that cannot use original sensitive datasets because they are not publicly accessible. One of the main challenges in this area is to preserve the privacy of individuals who participate in the training of the GAN models. To address this challenge, we introduce a Differentially Private Conditional GAN (DP-CGAN) training framework based on a new clipping and perturbation strategy, which improves the performance of the model while preserving privacy of the training dataset. DP-CGAN generates both synthetic data and corresponding labels and leverages the recently introduced R enyi differential privacy accountant to track the spent privacy budget. The experimental results show that DP-CGAN can generate visually and empirically promising results on the MNIST dataset with a single-digit epsilon parameter in differential privacy. 1 Introduction Recent studies have shown that deep neural networks (DNNs) can achieve state-of-the-art performance in various applications such as image recognition [1, 2], natural language processing [3], speech recognition [4, 5] and complex video games [6, 7].