SoCs for ML Training

Machine-learning (ML) training is a beast of a problem. And it would appear that the industry is unleashing silicon beasts in order to battle that training beast. Some of those were revealed at the recent Hot Chips conference, including the biggest "chip" ever made. In honor of the benefits of being large, this article will be longer than average – and still leave things out. Most of what I've covered in the past has been about machine-learning inference.