Opening Up Black Boxes with Explainable AI

One of the biggest challenges with deep learning is explaining to customers and regulators how the models get their answers. In many cases, we simply don't know how the models generated their answers, even if we're very confident in the answers themselves. However, in the age of GDPR, this black box-style of predictive computing will not suffice, which is driving a push by FICO and others to develop explainable AI. Describing deep learning as a black box is not meant to denigrate the practice. After, all, we're thrilled that, when we build a convolutional neural network with hundreds of input variables and more than a thousand hidden layers (as the biggest CNNs are), it just works.