Introduction to Convolutional Neural Networks (CNNs) The Most Popular Deep Learning architecture

This function used varies with the application, but some of the most used ones are the Sigmoid, ReLU and Leaky ReLU shown in this picture. More details about these activation functions are linked in below if that interests you. This transformed output is then sent to the next layer of neurons as input. They help to decide if the neuron would fire or not its information to the next layer. This output is then sent to a pooling layer.