uSF: Learning Neural Semantic Field with Uncertainty