A New Neural Kernel Regime: The Inductive Bias of Multi-Task Learning

Remarkably, the solutions learned for each individual task resemble those obtained by solving a kernel regression problem, revealing a novel connection between neural networks and kernel methods.