Patch Ranking: Efficient CLIP by Learning to Rank Local Patches