adaline neural network
Adaline neural networks: the origin of gradient descent
This story is part of a series I am creating about neural networks. This chapter is dedicated to a type of neural network known as adaptive linear unit (adaline), whose creation is attributed to Bernard Widrow and Ted Hoff shortly after the perceptron network. Although both adaline and the perceptron were inspired by the McCulloch and Pitts neuron, there are some subtle but significant differences between both networks, some of them having established the foundations of training algorithms in current neural network architectures. Ted Hoff was Widrow's doctorate student (fun fact: he was also Intel's employee number 12). Their partnership during this time resulted in adaline neuron's work, published in 1960.