Representing LLMs in Prompt Semantic Task Space