Language Models Encode Collaborative Signals in Recommendation