Learning and Unlearning of Fabricated Knowledge in Language Models