Large Language Models Must Be Taught to Know What They Don't Know