Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets