Supplement to ' Autoencoders that don't overfit towards the Identity '