Enabling Fast 2-bit LLM on GPUs: Memory Alignment and Asynchronous Dequantization

Open in new window