Activation Functions in Deep Neural Networks

Activation functions like ReLu, Sigmoid, and Tanh are used to add a non-linear property to the neural network. This way, the network can model more complex structures and patterns in the data.