Sample-efficient LLM Optimization with Reset Replay