CLMN: Concept based Language Models via Neural Symbolic Reasoning