The State of Explainable AI – Jillian Schwiep – Medium

I don't need to know exactly why Netflix recommends certain movies to me -- if it looks like a fit, I'm happy to take their recommendation. On the other hand, if your AI tells me that I should undergo an invasive medical treatment because a deep neural network (DNN) recommends it -- well, I'm going to want to understand why before I take your recommendation. AI deployed in military tools, financial tools such as loan assessments, or self-driving cars may use DNNs without being able to establishing culpability -- if we can't understand how an algorithm works, who's responsible when something goes wrong? As long as breakthroughs in artificial intelligence (AI) are common, researchers and startups will probably focus most of their effort into making new, flexible AI models. Maybe we can't explain how these models work, but if x.ai's Amy or Andrew can miraculously figure out how and when to schedule meetings for me, do I even care?