Identifying the Source of Generation for Large Language Models