What Is Data Echoing And How Does It Make Training Faster

What is the solution for faster training of deep neural networks? That is true, but now we have GPUs and TPUs. What if the speed is not enough? Should we develop processors that are even faster? No, says a team of researchers from Google AI.