Birds look like cars: Adversarial analysis of intrinsically interpretable deep learning