GUIDE: Guided Initialization and Distillation of Embeddings