Discovering General Reinforcement Learning Algorithms with Adversarial Environment Design -- Supplementary Materials 1 Hyperparameters 1 1.1 GROOVE 2