A Transfer Learning Details

We use performance on validation split of the target dataset for early stopping during finetuning. No early stopping is used during pretraining. Random horizontal flipping is also used. During finetuning, we additionally perform random rotation of up to 20 degrees. The datasets used in our experiments are described in Table 4. OpenImages is released under the Apache License 2.0.