NLP using Deep Learning Tutorials: Understand the Activation Function

This article is a first of a series that I'm writing, and where I will try to address the topic of using Deep Learning in NLP. First of all, I was writing an article for an example of text classification using a perceptron, but I was thinking that will be better to review some basics before, as activation and loss functions. Activation functions are introduced in neural networks to capture complex relationships in data. There are nonlinear functions added in general at the end of a network to transform data from complex to a simple format, which makes it easy to be interpreted depending on the main purpose of the model. There are many types of activation functions.