How AI Can Explain Its Thinking

In their paper published on February 15, 2018, the team outlined their work on a potential model for artificial intelligence, which they have aptly named the "Pointing and Justification Explanation," (PJ-X). Using this model, artificial intelligence gives textual and visual evidence for their decisions. For example, when given an image of a baseball game and asked what sport is depicted, the AI responds that it is baseball and highlights the areas of the image that it thinks are important. In the case of the baseball game, the AI will highlight the player's bat, the ball, and the catcher's mitt as justification for its analysis of the image.