64ad7b36b497f375ded2e6f15713ed4c-Paper-Conference.pdf

When developing deep learning models, we usually decide what task we want to solve then search for a model that generalizes well on the task. An intriguing question would be: what if, instead of fixing the task and searching in the model space, we fix the model and search in the task space?