What is explainable AI?

Artificial intelligence doesn't need any extra fuel for the myths and misconceptions that surround it. Consider the phrase "black box" – its connotations are equal parts mysterious and ominous, the stuff of "The X Files" more than the day-to-day business of IT. Yet it's true that AI systems, such as machine learning or deep learning, take inputs and then produce outputs (or make decisions) with no decipherable explanation or context. The system makes a decision or takes some action, and we don't necessarily know why or how it arrived at that outcome. The system just does it.