The Strange Loop in Deep Learning – Intuition Machine – Medium

Douglas Hofstadter in his book "I am a Strange Loop" coined this idea: Where he describes this self-referential mechanism as what describes the unique property of minds. The strange loop is a cyclic system that traverses several layers in a hierarchy. By moving through this cycle one finds oneself where one originally started. Coincidentally enough, this'strange loop' is in fact is the fundamental reason for what Yann LeCun describes as "the coolest idea in machine learning in the last twenty years." Loops are not typical in Deep Learning systems. These systems have conventionally been composed of acyclic graphs of computation layers.