reviewers raised, and then respond to some reviewers individually. 2 Synthetic vs. real experiments. R1 and R4 questioned how well our analysis for the synthetic experiments in Section

We thank the reviewers for their careful consideration of our work. R2 suggested that an analysis on non-toy models would be interesting to see. R3 believed that the synthetic experiment was not suited to the model class. We expect our analysis on smaller models to extrapolate to larger ones (R2). We regret that we were not clearer about how our aim differs from these studies [McMurray et al. (2012), ME would aid downstream learning as we propose or as is observed in humans in lifelong learning settings.