A Experimental settings

Neural Information Processing Systems 

The data was generated as described in Figure A.1 and Section 4.1. Augmentations were also initialized with uniform weights for AugNet.Figure A.1: Illustration of the data generation process for the Mario-Iggy experiment.Figure A.2: Magnitudes learned by Augerino are not sparse. The data was generated as described in Figure A.4 and Section 4.2. The trunk model used for Augnet is described in Table A.2. Moreover, λ was set to 0. 8 and initial magnitudes set to 0.05 in Section 4.3.