Humans are able to rapidly learn new concepts and continuously integrate them among prior knowledge.

First provide a summary of the paper, and then address the following criteria: Quality, clarity, originality and significance. This paper considers weighted majority algorithm and establishes consistency (error rate of the aggregator tending to zero) results under two settings: (1) when the competence level (risk of each expert) is known in advance and (2) when it is estimated. For case (2), frequentist and Bayesian methods for estimating the competence level are provided. For case (1), consistency is established in terms of providing upper and lower bounds on the error rate of the aggregator, which involve standard calculations ( apart from the fact that upper bound is established by invoking a result by Kearns and Saul, instead of Hoeffding's inequality). For case (2) under the frequentist setting, an independent set of labeled inputs is used to estimate the competence level of each expert.

We thank all reviewers for thoughtful feedback! We reply separately to each reviewer. Reviewer #1: We would like to point out some of the paper's main contributions, not fully recognized in the review. Another example is our algorithm for sampling DAGs conditionally on a root-partition (Sections 3.4 Accordingly, our main innovations are algorithmic. We would like to correct that our algorithm for sampling DAGs is not "classical" (cf.

We focus on the case of i.i.d.

We give a tractable unbiased estimate of the log density using a "Russian roulette" estimator, and reduce the memory required

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann Machines, probably the most well-studied class of latent variable models.