Invoke Interfaces Only When Needed: Adaptive Invocation for Large Language Models in Question Answering