The Emergence of Inside Out Architectures in Deep Learning

"The activity of the intuition consists in making spontaneous judgments which are not the result of conscious trains of reasoning. These judgments are often but by no means invariably correct. . . . The exercise of ingenuity in mathematics consists in aiding the intuition through suitable arrangements of propositions, and perhaps geometrical figures or drawings." There are many misunderstandings AI researchers hold on to that lead them to dead ends. The most well-known one is the idea that has driven GOFAI (Good Old Fashion AI) since the 1950s: intelligence can be reducible to simulating logical reasoning.