Neural Networks -Activation functions – Data Driven Investor – Medium

This post will help you understand the most common activation function used in machine learning, including deep learning. Prerequisite: It is advisable to have knowledge on a few machine learning algorithms and a basic understanding of artificial neural networks. Activation function helps decide if we need to fire a neuron or not and if we need to fire a neuron then what will be the strength of the signal. In neural network z is the product of the input node and weight for the node plus the bias. If the neuron value can range from -infinity to infinity then we will not be able to decide if we need to fire the neuron or not.