Imitating Language via Scalable Inverse Reinforcement Learning