Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbreaks