Simplest Neural Network & Activation – Long – Medium

There are three types of layer: input layer,hidden layer and output layer. Input layer is source of input data, we need normalize the data in the specific type or dimensions. Ok, this time, we implement a simplest neural network, it consist of one input layer, one hidden layer and one output layer. The previous blog, we use a linear formulation:y mx b, every variable is a number, this blog's demo, we will do matrix operation, if u unfamiliar with matrix, click this URL. Before we get start of our demo, let's see it in high level: The datasets contains of input data and output data, what we need to calculate is two weights.