Saliency Guided Longitudinal Medical Visual Question Answering