To aid the study of generalization in a more realistic setting that is still tractable for current RL algorithms, we present Avalon2: a benchmark and high-performance simulator.

Forpredictivemodels toprovidereliable guidance indecision making processes, they are often required to be accurate and robust to distribution shifts. Shortcut learning-where a model relies on spurious correlations or shortcuts to predict thetargetlabel-undermines therobustnessproperty,leadingtomodelswithpoor out-of-distribution accuracy despite good in-distribution performance.