Learning to Act Safely with Limited Exposure and Almost Sure Certainty