Backdoor Federated Learning by Poisoning Backdoor-Critical Layers