Backpropagation -- How Neural Networks Learn Complex Behaviors -- Autonomous Agents -- #AI

Learning is the most important ability and attribute of a Intelligent System. A system which acquires knowledge by experience, trial-and-error or through coaching, exhibits early traces of intelligence. This post explains how ANNs learn. In the previous post, 'Layman's Intro to AI', we explored a simple analogy of how a Artificial Neural Network or ANN gains to understand the'knowledge weight' of a Cat (or what we termed as the Catiness). 'w' is the knowledge weight that the network needs to learn (about the Catiness of a Cat) The '*' operator is a function called the Activation Function, which was introduced in the post titled "Mathematical foundation for Activation Functions".