On The Classification-Distortion-Perception Tradeoff

Liu, Dong, Zhang, Haochen, Xiong, Zhiwei

Neural Information Processing Systems 

Signal degradation is ubiquitous, and computational restoration of degraded signal has been investigated for many years. Recently, it is reported that the capability of signal restoration is fundamentally limited by the so-called perception-distortion tradeoff, i.e. the distortion and the perceptual difference between the restored signal and the ideal "original" signal cannot be made both minimal simultaneously. Distortion corresponds to signal fidelity and perceptual difference corresponds to perceptual naturalness, both of which are important metrics in practice. Besides, there is another dimension worthy of consideration--the semantic quality of the restored signal, i.e. the utility of the signal for recognition purpose. In particular, we consider the classification error rate achieved on the restored signal using a predefined classifier as a representative metric for semantic quality.