Verification Based Solution for Structured MAB Problems