Language Models as Hierarchy Encoders Yuan He

Neural Information Processing Systems 

Interpreting hierarchical structures latent in language is a key limitation of current language models (LMs). While previous research has implicitly leveraged these hierarchies to enhance LMs, approaches for their explicit encoding are yet to be explored.