Training Deep Net on 14 Million Images by Using A Single Machine -- mxnet 0.7.0 documentation

Before training the network, we need to shuffle these images then load batch of images to feed the neural network. Before we describe how we solve it, let's do some calculation first: A very naive approach is loading from a list by random seeking. If use this approach, we will spend 677 hours with HDD or 6.7 hours with SSD respectively. This is only about read. Although SSD looks not bad, but 1TB SSD is not affordable for everyone.