Golyadkin's Torment: Doppelg\"angers and Adversarial Vulnerability