Expanding the Action Space of LLMs to Reason Beyond Language