An exploration of the effect of quantisation on energy consumption and inference time of StarCoder2

Open in new window