Average gradient outer product as a mechanism for deep neural collapse

This assumes that DNNs are infinitely expressive and, thus, optimizes for the feature vectors in the last layer directly.