What if I train a deep neural network with random data?

Would you train a neural network with random data? Moreover, are massive neural networks just lookup tables or do they truly learn something? Today's episode is about memorisation and generalisation in deep learning, with Stanislaw Jastrzębski. Stan works as post-doc at New York University. I have asked Stan a few questions I was looking answers for a long time.