Fundamental Tradeoffs in Learning with Prior Information