What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation

However, no direct empirical evidence for this explanation or even an approach for obtaining such evidence were given. In this work we design experiments to test the key ideas in this theory.