Teaching Large Language Models an Unseen Language on the Fly