Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models