Establishing Knowledge Preference in Language Models