Review for NeurIPS paper: Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness
–Neural Information Processing Systems
Weaknesses: After reading the paper, it is still arguable why the distance-awareness is decisive for determining the uncertainty. Distance awareness is the property of the conventional local methods such as those using kernels. The experiment for the synthetic data will be reconstructed with conventional Gaussian Processes without neural networks. The effect of the replacement of the last layer seems obvious regarding the distance awareness, but it is unclear whether this distance awareness property is indeed advantageous. From this perspective, the theoretical property in Equation (6) is the property of conventional local methods.
deterministic deep learning, distance awareness, simple and principled uncertainty estimation, (1 more...)
Neural Information Processing Systems
Jan-24-2025, 12:02:53 GMT
- Technology: