Goto

Collaborating Authors

 Statistical Learning







7e0ff37942c2de60cbcbd27041196ce3-Paper.pdf

Neural Information Processing Systems

To measure the difference between two probability distributions, referred to as the source and target, respectively, we exploit both the chain rule and Bayes' theorem to construct conditional transport (CT), which is constituted by both a


Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles

Neural Information Processing Systems

When a deep learning model is deployed in the wild, it can encounter test data drawn from distributions different from the training data distribution and suffer drop in performance. For safe deployment, it is essential to estimate the accuracy of the pre-trained model on the test data. However, the labels for the test inputs are usually not immediately available in practice, and obtaining them can be expensive. This observation leads to two challenging tasks: (1) unsupervised accuracy estimation, which aims to estimate the accuracy of a pre-trained classifier on a set of unlabeled test inputs; (2) error detection, which aims to identify mis-classified test inputs. In this paper, we propose a principled and practically effective framework that simultaneously addresses the two tasks.


AutoML Two-Sample Test Jonas M. Kübler

Neural Information Processing Systems

Two-sample tests are important in statistics and machine learning, both as tools for scientific discovery as well as to detect distribution shifts.