Existing LLMs Are Not Self-Consistent For Simple Tasks