A Principled Framework for Knowledge-enhanced Large Language Model