Trustful LLMs: Customizing and Grounding Text Generation with Knowledge Bases and Dual Decoders