Cost-efficient Knowledge-based Question Answering with Large Language Models