How Compact?: Assessing Compactness of Representations through Layer-Wise Pruning