A Case For Explainable AI & Machine Learning

Yes, it is Holy Grail of AI and for the right reason; whether it about losing a High-Value customer due to wrong Churn Prediction or losing dollars due to incorrect classification of a financial transaction. In reality, Customers are the less bothered accuracy of AI model, but their concerns are about Cluelessness of Data Scientist to explain "How do I trust its decision making?" Data Scientists building credit risk models in the consumer space faced the transparency requirement probably for as long as this field existed, due to regulatory compliance which governs the consumer risk. Marketers also have been bound by certain rules which disallow protected categories such as gender or race to enter the models. These regulations were created in US to protect consumers.