Controlling Large Language Model with Latent Actions