resultant
Resultant: Incremental Effectiveness on Likelihood for Unsupervised Out-of-Distribution Detection
Li, Yewen, Wang, Chaojie, Xia, Xiaobo, He, Xu, An, Ruyi, Li, Dong, Liu, Tongliang, An, Bo, Wang, Xinrun
Unsupervised out-of-distribution (U-OOD) detection is to identify OOD data samples with a detector trained solely on unlabeled in-distribution (ID) data. The likelihood function estimated by a deep generative model (DGM) could be a natural detector, but its performance is limited in some popular "hard" benchmarks, such as FashionMNIST (ID) vs. MNIST (OOD). Recent studies have developed various detectors based on DGMs to move beyond likelihood. However, despite their success on "hard" benchmarks, most of them struggle to consistently surpass or match the performance of likelihood on some "non-hard" cases, such as SVHN (ID) vs. CIFAR10 (OOD) where likelihood could be a nearly perfect detector. Therefore, we appeal for more attention to incremental effectiveness on likelihood, i.e., whether a method could always surpass or at least match the performance of likelihood in U-OOD detection. We first investigate the likelihood of variational DGMs and find its detection performance could be improved in two directions: i) alleviating latent distribution mismatch, and ii) calibrating the dataset entropy-mutual integration. Then, we apply two techniques for each direction, specifically post-hoc prior and dataset entropy-mutual calibration. The final method, named Resultant, combines these two directions for better incremental effectiveness compared to either technique alone. Experimental results demonstrate that the Resultant could be a new state-of-the-art U-OOD detector while maintaining incremental effectiveness on likelihood in a wide range of tasks.
- Asia > Singapore (0.04)
- North America > United States > Massachusetts > Hampshire County > Amherst (0.04)
- Europe > United Kingdom (0.04)
Data Architect, Internal IT (Remote in US) at Resultant - Indianapolis, IN, United States
Resultant is a modern consulting firm with a radically different approach to solving problems. We don't solve problems for our clients. We solve problems with them. Through outcomes driven by data analytics, technology solutions, digital transformation, and beyond, our team works with clients in both the public and private sectors to solve their most complex challenges. We start by learning as much as we can about who they are, how they work, and what they're striving for so we can feel their problems as our own.
- North America > United States > Indiana > Marion County > Indianapolis (0.45)
- North America > United States > Texas > Dallas County > Dallas (0.07)
- North America > United States > Ohio > Franklin County > Columbus (0.07)
- (4 more...)
- Information Technology > Data Science (0.58)
- Information Technology > Artificial Intelligence (0.52)