RoRA-VLM: Robust Retrieval-Augmented Vision Language Models