We believe that R2 and R3 omitted key contributions that previous work has been unable to

We thank the reviewers for their feedback and their time. R2: "MAP can give more accurate predictions". Specifically, [11] shows overfitting to data yields better accuracy. "Bayesian Deep Learning and a Probabilistic Perspective of Generalization", section 9.1), which becomes more apparent For MF-VI, many units' variances converge to values close to prior variance, as shown in Figure 1 We will improve this writing in the paper. We also note that k-tied + our approach will yield higher ELBO than k-tied alone.