Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation

Neural Information Processing Systems 

Moreover, the training and storage costs of such method grow linearly with the number of potential scenarios.