Transfer learning with affine model transformation