Why Lift so Heavy? Slimming Large Language Models by Cutting Off the Layers