New approaches to Deep Networks - Capsules (Hinton), HTM (Numenta), Sparsey (Neurithmic Systems) and RCN (Vicarious) - Project AGI

The model is a neural network utilising HTM neurons [7] which resemble biological pyramidal neurons. These neurons are more complex than conventional artificial neural network neurons, with multiple groups and types of input connections (dendrites) with different functions. There are dendrites that are stimulators, and those that are modulatory, and predict activations. There is an input and output layer (resembling two of the cortical pyramidal cell layers) with feedback and lateral input connections. Neurons are arranged into columns that cover a subset of the input space.