Neural Network Zoo Prequel: Cells and Layers - The Asimov Institute

The Neural Network Zoo shows different types of cells and various layer connectivity styles, but it doesn't really go into how each cell type works. A number of cell types I originally gave different colours to differentiate the networks more clearly, but I have since found out that these cells work more or less the same way, so you'll find descriptions under the basic cell images. A basic neural network cell, the type one would find in a regular feed forward architecture, is quite simple. The cell is connected to other neurons via weights, i.e. it can be connected to all the neurons in the previous layer. Each connection has its own weight, which is often just a random number at first.