Adapting to noise distribution shifts in flow-based gravitational-wave inference