Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization

Instead their main role is to provide inertia during training. We interpret current methods in terms of inertia and provide novel insights into the optimization of BNNs.