6 Steps To Write Any Machine Learning Algorithm From Scratch: Perceptron Case Study

Writing a machine learning algorithm from scratch is an extremely rewarding learning experience. It provides you with that "ah ha!" moment where it finally clicks, and you understand what's really going on under the hood. Some algorithms are just more complicated than others, so start with something simple, such as the single layer Perceptron. I'll walk you through the following 6-step process to write algorithms from scratch, using the Perceptron as a case-study: This goes back to what I originally stated. If you don't understand the basics, don't tackle an algorithm from scratch. For the Perceptron, let's go ahead and answer these questions: After you have a basic understanding of the model, it's time to start doing your research. Some people learn better with textbooks, some people learn better with video.