There are No Bit Parts for Sign Bits in Black-Box Attacks