Text to Band Gap: Pre-trained Language Models as Encoders for Semiconductor Band Gap Prediction