Rethinking Exponential Averaging of the Fisher