From Features to Transformers: Redefining Ranking for Scalable Impact