Learning from Infinite Data in Finite Time