Language Model Task -specific Model Tokenization Next action at Observation o t History h t Goal g Tokenization Tokenization F

Language model (LM) pre-training is useful in many language processing tasks. But can pre-trained LMs be further leveraged for more general machine learning problems?