Accuracy
AI-based Malware and Ransomware Detection Models
Marais, Benjamin, Quertier, Tony, Morucci, Stéphane
Cybercrime is one of the major digital threats of this century. In particular, ransomware attacks have significantly increased, resulting in global damage costs of tens of billion dollars. In this paper, we train and test different Machine Learning and Deep Learning models for malware detection, malware classification and ransomware detection. We introduce a novel and flexible solution that combines two optimized models for malware and ransomware detection. Our results demonstrate some improvements both in terms of detection performances and flexibility. In particular, our combined models pave the way for easier future enhancements using specialized and thus interchangeable detection modules.
A Critical Analysis of Classifier Selection in Learned Bloom Filters
Malchiodi, Dario, Raimondi, Davide, Fumagalli, Giacomo, Giancarlo, Raffaele, Frasca, Marco
Learned Bloom Filters, i.e., models induced from data via machine learning techniques and solving the approximate set membership problem, have recently been introduced with the aim of enhancing the performance of standard Bloom Filters, with special focus on space occupancy. Unlike in the classical case, the "complexity" of the data used to build the filter might heavily impact on its performance. Therefore, here we propose the first in-depth analysis, to the best of our knowledge, for the performance assessment of a given Learned Bloom Filter, in conjunction with a given classifier, on a dataset of a given classification complexity. Indeed, we propose a novel methodology, supported by software, for designing, analyzing and implementing Learned Bloom Filters in function of specific constraints on their multi-criteria nature (that is, constraints involving space efficiency, false positive rate, and reject time). Our experiments show that the proposed methodology and the supporting software are valid and useful: we find out that only two classifiers have desirable properties in relation to problems with different data complexity, and, interestingly, none of them has been considered so far in the literature. We also experimentally show that the Sandwiched variant of Learned Bloom filters is the most robust to data complexity and classifier performance variability, as well as those usually having smaller reject times. The software can be readily used to test new Learned Bloom Filter proposals, which can be compared with the best ones identified here.
Generating 2D and 3D Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution
Friedlander, Tomer, Shmelkin, Ron, Wolf, Lior
A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. For 2D face verification, multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network to direct the search toward promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a considerable coverage of the identities in the LFW or RFW datasets with less than 10 master faces, for six leading deep face recognition systems. In 3D, we generate faces using the 2D StyleGAN2 generator and predict a 3D structure using a deep 3D face reconstruction network. When employing two different 3D face recognition systems, we are able to obtain a coverage of 40%-50%. Additionally, we present the generation of paired 2D RGB and 3D master faces, which simultaneously match 2D and 3D models with high impersonation rates.
Automated Detection of Dolphin Whistles with Convolutional Networks and Transfer Learning
Korkmaz, Burla Nur, Diamant, Roee, Danino, Gil, Testolin, Alberto
Effective conservation of maritime environments and wildlife management of endangered species require the implementation of efficient, accurate and scalable solutions for environmental monitoring. Ecoacoustics offers the advantages of non-invasive, long-duration sampling of environmental sounds and has the potential to become the reference tool for biodiversity surveying. However, the analysis and interpretation of acoustic data is a time-consuming process that often requires a great amount of human supervision. This issue might be tackled by exploiting modern techniques for automatic audio signal analysis, which have recently achieved impressive performance thanks to the advances in deep learning research. In this paper we show that convolutional neural networks can indeed significantly outperform traditional automatic methods in a challenging detection task: identification of dolphin whistles from underwater audio recordings. The proposed system can detect signals even in the presence of ambient noise, at the same time consistently reducing the likelihood of producing false positives and false negatives. Our results further support the adoption of artificial intelligence technology to improve the automatic monitoring of marine ecosystems.
AI Enabled Maneuver Identification via the Maneuver Identification Challenge
Samuel, Kaira, LaRosa, Matthew, McAlpin, Kyle, Schaefer, Morgan, Swenson, Brandon, Wasilefsky, Devin, Wu, Yan, Zhao, Dan, Kepner, Jeremy
Artificial intelligence (AI) has enormous potential to improve Air Force pilot training by providing actionable feedback to pilot trainees on the quality of their maneuvers and enabling instructor-less flying familiarization for early-stage trainees in low-cost simulators. Historically, AI challenges consisting of data, problem descriptions, and example code have been critical to fueling AI breakthroughs. The Department of the Air Force-Massachusetts Institute of Technology AI Accelerator (DAF-MIT AI Accelerator) developed such an AI challenge using real-world Air Force flight simulator data. The Maneuver ID challenge assembled thousands of virtual reality simulator flight recordings collected by actual Air Force student pilots at Pilot Training Next (PTN). This dataset has been publicly released at Maneuver-ID.mit.edu and represents the first of its kind public release of USAF flight training data. Using this dataset, we have applied a variety of AI methods to separate "good" vs "bad" simulator data and categorize and characterize maneuvers. These data, algorithms, and software are being released as baselines of model performance for others to build upon to enable the AI ecosystem for flight simulator training.
Who is Gambling? Finding Cryptocurrency Gamblers Using Multi-modal Retrieval Methods
Huang, Zhengjie, Liu, Zhenguang, Chen, Jianhai, He, Qinming, Wu, Shuang, Zhu, Lei, Wang, Meng
With the popularity of cryptocurrencies and the remarkable development of blockchain technology, decentralized applications emerged as a revolutionary force for the Internet. Meanwhile, decentralized applications have also attracted intense attention from the online gambling community, with more and more decentralized gambling platforms created through the help of smart contracts. Compared with conventional gambling platforms, decentralized gambling have transparent rules and a low participation threshold, attracting a substantial number of gamblers. In order to discover gambling behaviors and identify the contracts and addresses involved in gambling, we propose a tool termed ETHGamDet. The tool is able to automatically detect the smart contracts and addresses involved in gambling by scrutinizing the smart contract code and address transaction records. Interestingly, we present a novel LightGBM model with memory components, which possesses the ability to learn from its own misclassifications. As a side contribution, we construct and release a large-scale gambling dataset at https://github.com/AwesomeHuang/Bitcoin-Gambling-Dataset to facilitate future research in this field. Empirically, ETHGamDet achieves a F1-score of 0.72 and 0.89 in address classification and contract classification respectively, and offers novel and interesting insights.
Algorithmic Bias in Machine Learning Based Delirium Prediction
Tripathi, Sandhya, Fritz, Bradley A, Avidan, Michael S, Chen, Yixin, King, Christopher R
Although prediction models for delirium, a commonly occurring condition during general hospitalization or post-surgery, have not gained huge popularity, their algorithmic bias evaluation is crucial due to the existing association between social determinants of health and delirium risk. In this context, using MIMIC-III and another academic hospital dataset, we present some initial experimental evidence showing how sociodemographic features such as sex and race can impact the model performance across subgroups. With this work, our intent is to initiate a discussion about the intersectionality effects of old age, race and socioeconomic factors on the early-stage detection and prevention of delirium using ML.
Neural Network Verification as Piecewise Linear Optimization: Formulations for the Composition of Staircase Functions
Anh-Nguyen, Tu, Huchette, Joey
We present a technique for neural network verification using mixed-integer programming (MIP) formulations. We derive a \emph{strong formulation} for each neuron in a network using piecewise linear activation functions. Additionally, as in general, these formulations may require an exponential number of inequalities, we also derive a separation procedure that runs in super-linear time in the input dimension. We first introduce and develop our technique on the class of \emph{staircase} functions, which generalizes the ReLU, binarized, and quantized activation functions. We then use results for staircase activation functions to obtain a separation method for general piecewise linear activation functions. Empirically, using our strong formulation and separation technique, we can reduce the computational time in exact verification settings based on MIP and improve the false negative rate for inexact verifiers relying on the relaxation of the MIP formulation.
Deep Fake Detection, Deterrence and Response: Challenges and Opportunities
Azmoodeh, Amin, Dehghantanha, Ali
Afterward, we offer a solution that is capable of 1) making our AI systems robust against deepfakes during development and deployment phases; 2) detecting video, image, audio, and textual deepfakes; 3) identifying deepfakes that bypass detection (deepfake hunting); 4) leveraging available intelligence for timely identification of deepfake campaigns launched by state-sponsored hacking teams; 5) conducting in-depth forensic analysis of identified deepfake payloads. Our proposed solution can be used as a technical guide for developing detection, deterrence, and forensics investigation solutions for deepfakes. Our solution would address important elements of Canada's National Cyber Security Action Plan (2019-2024) in increasing the trustworthiness of our critical services [5]. Following actions can be taken based on this research findings: Raising public awareness about risks of deepfakes: increasing the understanding of deepfake threats and empowering Canadian public to do their part in keeping our society and critical services safe from deepfake-based attacks is the most important and effective step in reducing risk of deepfakes. Cybersecurity should always be considered as a shared responsibility. While this paper is focused on development of technical solutions for early detection and deterrence of deepfakes, the effectiveness of our solutions (or any technical solution in cybersecurity) are limited without regular and systemic public awareness campaigns. Supporting development of public training programs in this domain should be considered as a top priority. Developing AI robustness monitoring solutions: there is a growing trend in using AI to detect deepfakes. However, more recently, adversaries made attempts to create adversarial deepfake payloads that are capable of deceiving humans while bypassing AI-based detection systems!
Predicting Dog Breed with a CNN
Convolutional neural networks (CNNs) are an incredibly useful tool for analysing pictures, and in this article, we attempt to use one to identify breed given an image of a dog. On top of this, we also aim to input pictures of humans into the model and output the breed the human looks most similar to. To input into the model, we were provided with over 8,000 dog images each accompanied with the corresponding breed -- a total of 133 breeds over the whole dataset. To undertake this task, it was important to understand the theory behind CNNs and how they work, with particular application to how they work for image classification. The first consideration is how images can be represented for input to a CNN.