Deep learning systems to explain their decisions

"In real-world applications, sometimes people want to know why the model makes the predictions it does," said graduate student Tao Lei. "One major reason that doctors don't trust machine-learning methods is that there's no evidence." "You may not want to just verify that the model is making the prediction in the right way; you might also want to exert some influence in terms of the types of predictions that it should make," commented Tommi Jaakkola, an MIT professor of electrical engineering and computer science. The researchers address neural nets trained on textual data. To enable interpretation of a neural net's decisions, the group divide the net into two modules.