Can Large Language Models Play Games? A Case Study of A Self-Play Approach