First Steps Toward Understanding the Extrapolation of Nonlinear Models to Unseen Domains