Unsupervised learning, attention, and other mysteries

What was the evolution of your interest in machine learning, and how did you zero-in on your Ph.D. work? Ilya Sutskever: I started my Ph.D. just before deep learning became a thing. I was working on a number of different projects, mostly centered around neural networks.