Exploiting Latent Properties to Optimize Neural Codecs