CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals