Deep Learning Lesson 2: Activation Function

Welcome to the second lesson in our Practicing Deep Learning Series. Thoughtly is writing a multi-part tutorial series focused on understanding the foundations of Deep Learning, specifically as they apply to Natural Language Processing. If you want to jump to another post check the post listing here. Last time we focused on the elements of a simple single neuron network. We specifically discussed those that feed into the neuron – the inputs and weights – and their interaction via the dot product.