Supplementaryfor: MomentumCenteringand Asynchronous Update for Adaptive Gradient Methods Contents