Unleash the Potential of Image Branch for Cross-modal 3D Object Detection