Afford-X: Generalizable and Slim Affordance Reasoning for Task-oriented Manipulation