Deep learning is creating computer systems we don't fully understand

To compare where the humans and machines looked, the researchers created "attention" heat maps that could be laid over one another. On a scale of 0 to 1, where 0 is no overlap at all and 1 is complete overlap, the researchers found that the attention maps from the humans lined up at a rate of 0.63. But when comparing humans to machines, this figure was just 0.26. Explaining this difference is tricky. In one question in the study, for example, the humans and neural networks where shown a picture of a bedroom, and asked: "What is covering the windows?"