Multi-Modal Transformer and Reinforcement Learning-based Beam Management