AI/ML Security Pro Tips: Class Imbalance and Missing Labels

"Any AI smart enough to pass a Turing test is smart enough to know to fail it." Suppose you are working on a high-impact yet challenging problem of malware classification. You have a large dataset at your disposal and are able to train a machine learning classifier with an accuracy of 98%. While suppressing your excitement, you convince the team to deploy the model, as who would resist a model with such an amazing performance? Quite disappointingly, the model fails to detect threats in the real world!?