Mitigating Semantic Collapse in Partially Relevant Video Retrieval