LEEP: Measuring Transferability of Learned Representations

Summary: Transfer Learning (TL) may be the most important aid to adoption of deep learning in the last several years. This new LEEP measure predicts the accuracy of the transfer and should make TL faster, cheaper, and better. What is the single most important innovation in deep learning in the last several years? There might be several candidates. You might argue for tensorflow specific chips, or BERT architecture for improving NLP.