Tiny Refinements Elicit Resilience: Toward Efficient Prefix-Model Against LLM Red-Teaming