Two-Stage ML-Guided Decision Rules for Sequential Decision Making under Uncertainty