Goto

Collaborating Authors

 Large Language Model









BIGBIO: A Biomedical

Neural Information Processing Systems

BLUE (Biomedical Language Understanding Evaluation) is abenchmarkfor 10 datasetsrepresenting 5 tasks [34]. BLURB (Biomedical Language Understanding and Reasoning Benchmark) includes 13 datasetsand 7 tasks [19].



Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models Bowen Ping

Neural Information Processing Systems

Recent studies suggest decomposing a fine-tuned LLM into a base model and corresponding delta weights, which are then compressed using low-rank or low-bit approaches to reduce costs. In this work, we observe that existing low-rank and low-bit compression methods can significantly harm the model performance for task-specific fine-tuned LLMs (e.g., WizardMath for math problems).