Pulling back information geometry