Efficient Large Language Models with Zero-Shot Adjustable Acceleration