Finding Structure in Language Models