WESE: Weak Exploration to Strong Exploitation for LLM Agents