Residual Feature Integration is Sufficient to Prevent Negative Transfer