LLMs Can Generate a Better Answer by Aggregating Their Own Responses