Supplementary Material for "K-L ITE: Learning Transferable Visual Models with External Knowledge "