Supplementary material for "FETA: Towards Specializing Foundation Models for Expert Task Applications " Sivan Harary