Less is More: Making Smaller Language Models Competent Subgraph Retrievers for Multi-hop KGQA