Listening to Sounds of Silence for Speech Denoising