Rethinking Causality-driven Robot Tool Segmentation with Temporal Constraints