HBLLM: Wavelet-Enhanced High-Fidelity 1-Bit Quantization for LLMs

Neural Information Processing Systems 

We introduce HBLLM, a wavelet-enhanced high-fidelity $1$-bit post-training quantization method for Large Language Models (LLMs). By leveraging Haar wavelet transforms to enhance expressive capacity through frequency decomposition, HBLLM significantly improves quantization fidelity while maintaining minimal overhead.