The PyTorch training loop

However, this does not look very efficient. Especially, the part where we update our weights. Instead of having to go through every layer and updating its parameters, it'll be nice if we can update all our parameters together.