Uncovering the Hidden Cost of Model Compression