Inoursetup,armsareassociated with fixed costs and are ordered, forming acascade. In each round, acontext is presented, andthelearner selects thearmssequentially tillsome depth.

The pressure for survival prohibits slow, linear adaptation to different goals, i.e., learning value functions from scratch for each new objective. A quick and versatile paradigm is necessary forsuchgoal-directed learning scenarios.