How Cargo Cult Statistics encourages Deep Learning Alchemy

There is a struggle today for the heart and minds of Artificial Intelligence. It's a complex "Game of Thrones" conflict that involves many houses (or tribes) (see: "The Many Tribes of AI"). The two waring factions I focus on today is those who practice Cargo Cult science in the form of Bayesian statistics and those who practice alchemy in the form of experimental Deep Learning. For the uninitiated, let's talk about what Cargo Cult science means. Cargo Cult science is a phrased coined by Richard Feynman to illustrate a practice of in science of not working from fundamentally sound first principles.