Swapout: Learning an ensemble of deep architectures

When viewed as an ensemble training method, it samples a much richer set of architectures than existing methods such as dropout or stochastic depth.