Sign-In to the Lottery: Reparameterizing Sparse Training

The performance gap between training sparse neural networks from scratch (PaI) and dense-to-sparse training presents a major roadblock for efficient deep learning.