Poor Hardware Utilization Puts Squeeze on AI Compression