Neural Networks Basics: Activation Functions

An activation function in an artificial neural network decides whether a neuron should activate or not. There are many reasons why we use activation functions, one of them is to introduce non-linearity in the neural network. The linear activation function returns the input directly without changing it in any way. In other words, the output of the linear activation function is the same as the input. The linear activation function has a linear graph, hence the name.