Cluster-Learngene: Inheriting Adaptive Clusters for Vision Transformers

Neural Information Processing Systems 

In recent years, the merging of vast datasets with powerful computational resources has led to the emergence of large pre-trained models in the field of deep learning.