For both problems, the classical performance measure is the learner's (static) regret, defined as the difference between the learner's total loss and the loss of the best fixed action.
This phenomenon, that we coin "fast and furious" learning in games, sets a new benchmark about what is possible both in max-min optimization as well as in multi-agent systems.