Massively Scaling Explicit Policy-conditioned Value Functions