Neural Network Activation Function Types - FinTechExplained - Medium

This article aims to explain how the activation functions work in a neural network. Activation function is nothing but a mathematical function that takes in an input and produces an output. The function is activated when the computed result reaches the specified threshold. Finally, the computed value is fed into the activation function, which then prepares an output. Think of the activation function as a mathematical operation that normalises the input and produces an output.