On Conditional and Compositional Language Model Differentiable Prompting