Higher Layers Need More LoRA Experts