OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment