Statistical Learning
Supplementary material for'Spike and slab variational Bayes for high dimensional logistic regression '
(Section 11). Lemma 2. Suppose the prior satisfies Lemma 3. Suppose the prior satisfies Lemma 4. Suppose the prior satisfies This is the most difficult technical step in establishing our result. Lemma 5. Consider the event We briefly explain the heuristic idea behind the proof of Lemma 5. Since the VB posterior We also work with the default parametrization of the bmlasso function of the BhGLM package, i.e. We provide five further test cases in addition to the experiment considered in Section 5. In all cases we consider Gaussian design matrices, but vary all other parameter. We ran each experiment 200 times and report the means and standard deviations of the performance metrics in Table 3.
different hyperparameter choices, (iii) coverage of our VB credible sets, and (2) expanded the discussion in the final
We thank the reviewers for their constructive suggestions. A summary of the added discussion is provided point-by-point below. Reviewer 1: How much more work is needed versus linear regression. The technical details are thus different (and more involved) here. We have included these derivations for completeness.
Necessary and sufficient graphical conditions for optimal adjustment sets in causal graphical models with hidden variables
The problem of selecting optimal backdoor adjustment sets to estimate causal effects in graphical models with hidden and conditioned variables is addressed. Previous work has defined optimality as achieving the smallest asymptotic estimation variance and derived an optimal set for the case without hidden variables.
Robust Bayesian Regression via Hard Thresholding Zheyi Fan
By combining robust regression and prior information, we develop an effective robust regression method that can resist adaptive adversarial attacks. Due to the widespread existence of noise and data corruption, it is necessary to recover the true regression parameters when a certain proportion of the response variables have been corrupted. Methods to overcome this problem often involve robust least-squares regression. However, few methods achieve good performance when dealing with severe adaptive adversarial attacks. Based on the combination of prior information and robust regression via hard thresholding from [ 1 ], this paper proposes an algorithm that improves the breakdown point when facing adaptive adversarial attacks. Furthermore, to improve the robustness and reduce the estimation error caused by the inclusion of a prior, the idea of Bayesian reweighting is used to construct a more robust algorithm. We prove the theoretical convergence of proposed algorithms under mild conditions. Extensive experiments show that, under different dataset attacks, our algorithms achieve state-of-the-art results compared with other benchmark algorithms, demonstrating the robustness of the proposed approach.