Deep learning Malaysia presentation 12/4/2017

Once ordered alphabetically, each word can be referenced by its index, i.e. a, cat, chased, climbed, dog, saw, the, tree}. For this example, the neural network will have eight input neurons and eight output neurons. Let us assume that we decide to use three neurons in the hidden layer. This means that Winput and Woutput will be 8 3 and 3 8 matrices, respectively. Before training begins, these matrices are initialized to small random values as is usual in neural network training.