Decomposition of Small Transformer Models