Learn When (not) to Trust Language Models: A Privacy-Centric Adaptive Model-Aware Approach