MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

Open in new window