Improving OOD Generalization of Pre-trained Encoders via Aligned Embedding-Space Ensembles