On the Informativeness of Supervision Signals