Interleaving Fast and Slow Decision Making