Learning to Be Cautious