Deep Learning Unknowable Knowns – Intuition Machine – Medium

One good way to frame the question of the limits of Deep Learning is in the context of the Principle of Computational Equivalence by Stephen Wolfram. Wolfram showed that simple cellular automation are able to exhibit complex behaviour that cannot be predicted from initial conditions or the simple rules that specify its incremental behaviour. Certain kinds of cellular automata can exhibit complex behaviour that cannot be reduced to a mathematical model that capture its behaviour in closed form. Wolfram examples of an'irreducible' system that exhibits this complex behaviour are the brain and weather systems. Wolfram classifies these kinds of systems as exhibiting "Universality".