SUIT: Learning Significance-guided Information for 3D Temporal Detection