SD$^2$: Self-Distilled Sparse Drafters