Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts