Goto

Collaborating Authors

 Performance Analysis






A TT A: Anomaly-aware Test-Time Adaptation for Out-of-Distribution Detection in Segmentation

Neural Information Processing Systems

We quantify the drop in PEBAL's performance with the added domain shift and compare it to the performance when combined with our method or existing test-time adaptation methods such as



DRAUC: An Instance-wise Distributionally Robust AUC Optimization Framework

Neural Information Processing Systems

Distributionally Robust Optimization (DRO) enhances model performance by optimizing it for the local worst-case scenario, but directly integrating AUC optimization with DRO results in an intractable optimization problem.



Students Parrot Their Teachers: Membership Inference on Model Distillation Matthew Jagielski

Neural Information Processing Systems

Model distillation is frequently proposed as a technique to reduce the privacy leakage of machine learning. These empirical privacy defenses rely on the intuition that distilled "student" models protect the privacy of training data, as they only interact with this data indirectly through a "teacher" model. In this work, we design membership inference attacks to systematically study the privacy provided by knowledge distillation to both the teacher and student training sets. Our new attacks show that distillation alone provides only limited privacy across a number of domains. We explain the success of our attacks on distillation by showing that membership inference attacks on a private dataset can succeed even if the target model is never queried on any actual training points, but only on inputs whose predictions are highly influenced by training data. Finally, we show that our attacks are strongest when student and teacher sets are similar, or when the attacker can poison the teacher set.