Review for NeurIPS paper: Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Counts

Neural Information Processing Systems 

Weaknesses: While the paper proposes an interesting solution, I believe it falls short on a range of aspects which greatly affected my score. It is not clear what measures of uncertainty are used for OOD detection. Previous work on Prior Networks and ensemble methods consistently make use of mutual information to obtain a separable set of estimates of total, aleatoric and epistemic uncertainty. However, this work does neither mentions this nor uses these *established* and *theoretically meaningful* measures. Rather perplexingly, this work seems to make use of max alpha_c {I} scores for Prior Network and variance of probability for ensembles.