Enhancing PPO with Trajectory-Aware Hybrid Policies