Hard labels sampled from sparse targets mislead rotation invariant algorithms