Is Scaling Learned Optimizers Worth It? Evaluating The Value of VeLO's 4000 TPU Months

Open in new window