Can AI Assistants Know What They Don't Know?