Debugging Concept Bottleneck Models through Removal and Retraining