Online Learning-based Adaptive Beam Switching for 6G Networks: Enhancing Efficiency and Resilience