The Complexity of Neurons are Beyond Our Current Imagination

One of the biggest misconceptions around is the idea that Deep Learning or Artificial Neural Networks (ANN) mimc biological neurons. At best, ANN mimic a cartoonish version of a 1957 model of a neuron. Neurons in Deep Learning are essentially mathematical functions that perform a similarity function of its inputs against it internal weights. The closer a match is made, the more likely an action is performed (i.e. There are exceptions to this model (see: Autoregressive networks) however it is general enough to include the perceptron, convolution networks and RNNs.