Towards Atoms of Large Language Models