SpinalNet: Deep Neural Network with Gradual Input

The above figure is to show how a simpler version of SpinalNet can be converted to a single hidden layer NN. In Fig- 4(a), the first layer neurons are simplified by making them as linear functions. So, the first layer only takes the weighted sum of x1 to x5 inputs. Now, from the first layer, the output only goes to the corresponding neuron in the second layer. All cross-connections between neurons of two layers and the connections with the output layer are disconnected by assigning weight zero.