Tensor Normal Training for Deep Learning Models

T ensor Normal Training (TNT), which like Shampoo, only requires knowledge of the shape of the training parameters.