Transferring Knowledge from Large Foundation Models to Small Downstream Models