Correlation-Aware Dual-View Pose and Velocity Estimation for Dynamic Robotic Manipulation