XTC: ExtremeCompressionforPre-trained TransformersMadeSimpleandEfficient

Asaresult,wefindoutthatprevious baselines for ultra-low bit precision quantization are significantly under-trained. Based on our study,we propose asimple yet effectivecompression pipeline for extreme compression, named XTC.