Explainable AI: Why visualizing neural networks is important

Last week, researchers from OpenAI and Google introduced Activation Atlases, a tool that helps make sense of the inner workings of neural networks by visualizing how they see and classify different objects. At first glance, Activation Atlases is an amusing tool helps you see the world through the eyes of AI models. But it also one of the many important efforts that are helping explain decisions made by neural networks, one of the greatest challenges of the AI industry and an important hurdle in trusting AI in critical tasks. Artificial intelligence, or namely its popular subset deep learning, is far from the only kind of software we're using. We've been using software in different fields for decades.