Goto

Collaborating Authors

 Deep Learning


What Are Artificial Intelligence, Machine Learning, and Deep Learning?

#artificialintelligence

As you can see, there are dozens of techniques in each of these fields, and researchers generate new algorithms on a weekly basis. Although those algorithms might be complex, the conceptual differences as explained above are not. We hope this has been useful in helping you differentiate between these terms.


Process Monitoring on Sequences of System Call Count Vectors

arXiv.org Machine Learning

System call streams are enormous, and an efficient representation with performance guarantees independent of the level of activity on the host must be used. Some earlier work was based on processing of sequential streams of system calls [1], [2], which does not scale well -- a single process can produce tens of thousands system calls per second, with hundreds of processes running on each host, or end point. Other approaches rely on computing frequencies of short sequences (n-grams) of system calls over a fixed time window [3], [4]. However, in this case information about temporal dynamics of the process is lost. Further on, both from security and performance points of view some of the processing is sent from the monitored host to the monitoring server -- a different machine, dedicated to the monitoring task. This poses additional restrictions on the amount of data which can be collected: on the one hand, the network load must stay within the allowed limits; on the other hand, the machine executing the monitoring task must be able to process data from multiple hosts in the network. In this paper we introduce a new methodology for monitoring networked computer systems based on system calls.


SCAN: Learning Abstract Hierarchical Compositional Visual Concepts

arXiv.org Machine Learning

The natural world is infinitely diverse, yet this diversity arises from a relatively small set of coherent properties and rules, such as the laws of physics or chemistry. We conjecture that biological intelligent systems are able to survive within their diverse environments by discovering the regularities that arise from these rules primarily through unsupervised experiences, and representing this knowledge as abstract concepts. Such representations possess useful properties of compositionality and hierarchical organisation, which allow intelligent agents to recombine a finite set of conceptual building blocks into an exponentially large set of useful new concepts. This paper describes SCAN (Symbol-Concept Association Network), a new framework for learning such concepts in the visual domain. We first use the previously published beta-VAE (Higgins et al., 2017a) architecture to learn a disentangled representation of the latent structure of the visual world, before training SCAN to extract abstract concepts grounded in such disentangled visual primitives through fast symbol association. Our approach requires very few pairings between symbols and images and makes no assumptions about the choice of symbol representations. Once trained, SCAN is capable of multimodal bi-directional inference, generating a diverse set of image samples from symbolic descriptions and vice versa. It also allows for traversal and manipulation of the implicit hierarchy of compositional visual concepts through symbolic instructions and learnt logical recombination operations. Such manipulations enable SCAN to invent and learn novel visual concepts through recombination of the few learnt concepts.


Deep Over-sampling Framework for Classifying Imbalanced Data

arXiv.org Machine Learning

Class imbalance is a challenging issue in practical classification problems for deep learning models as well as traditional models. Traditionally successful countermeasures such as synthetic over-sampling have had limited success with complex, structured data handled by deep learning models. In this paper, we propose Deep Over-sampling (DOS), a framework for extending the synthetic over-sampling method to exploit the deep feature space acquired by a convolutional neural network (CNN). Its key feature is an explicit, supervised representation learning, for which the training data presents each raw input sample with a synthetic embedding target in the deep feature space, which is sampled from the linear subspace of in-class neighbors. We implement an iterative process of training the CNN and updating the targets, which induces smaller in-class variance among the embeddings, to increase the discriminative power of the deep representation. We present an empirical study using public benchmarks, which shows that the DOS framework not only counteracts class imbalance better than the existing method, but also improves the performance of the CNN in the standard, balanced settings.


How Deep Learning Can Change Highway Transportation

#artificialintelligence

While driverless cars get the glory, an AI startup is shifting gears to tackle a road less traveled: automated trucks. Beijing-based TuSimple, is developing a driverless trucking platform, TuSimple CTO Xiaodi Hou explained in a conversation with Michael Copeland in this week's episode of the AI Podcast. A shortage of drivers in Beijing, coupled with the challenge of finding drivers willing to travel on deserted roads in areas with few amenities, only bolsters TuSimple's business case. "If you can show people that this tool can replace your existing tool and can make your tool chain cheaper, more productive, it's much easier to negotiate with people like that," Xiaodi says. The challenge lies in increasing a fully loaded truck's range of vision to over 200 meters or approximately 0.12 miles, using highly customized cameras and lenses, to ensure safety.


Medical Image Analysis with Deep Learning , Part 4

@machinelearnbot

Nvidia GTC conference 2017 was an excellent source for all the effort on work on health care in Deep learning. Deep learning experts such as Ian GoodFellow, Jeremy Howard and others shared their perspective on Deep learning. Top medical schools (Mount Sinai, NYU, Massachusetts General Hospital, etc.) and Kaggle -- lung cancer BOWL winners explained their modeling strategies. Coming back to our series, in the last article we talked about basic deep-learning on text and image data. In this article we will focus on the medical images and their formats.


neural-networks-tutorial

#artificialintelligence

Recommended online course: If you like video courses, I'd recommend the following inexpensive Udemy course on neural networks: Deep Learning A-Z: Hands-On Artificial Neural Networks Here's an outline of the tutorial, with links, so you can easily navigate to the parts you want: Artificial neural networks (ANNs) are software implementations of the neuronal structure of our brains. In a supervised ANN, the network is trained by providing matched input and output data samples, with the intention of getting the ANN to provide a desired output for a given input. As mentioned previously, biological neurons are connected hierarchical networks, with the outputs of some neurons being the inputs to others. These structures can come in a myriad of different forms, but the most common simple neural network structure consists of an input layer, a hidden layer and an output layer.


Neural Networks Tutorial - A Pathway to Deep Learning - Adventures in Machine Learning

#artificialintelligence

Recommended online course: If you like video courses, I'd recommend the following inexpensive Udemy course on neural networks: Deep Learning A-Z: Hands-On Artificial Neural Networks Here's an outline of the tutorial, with links, so you can easily navigate to the parts you want: Artificial neural networks (ANNs) are software implementations of the neuronal structure of our brains. In a supervised ANN, the network is trained by providing matched input and output data samples, with the intention of getting the ANN to provide a desired output for a given input. As mentioned previously, biological neurons are connected hierarchical networks, with the outputs of some neurons being the inputs to others. These structures can come in a myriad of different forms, but the most common simple neural network structure consists of an input layer, a hidden layer and an output layer.


Google's New Project Is Aimed at Improving AI and Machine Learning

#artificialintelligence

Google has made great strides in artificial intelligence in recent years. It has already shown the world its DeepMind AI can defeat humans in ancient board games. It has launched one of the most advanced AI assistants for smartphones and other Internet-connected products. But Google wants AI to have a humanistic side, to be more inclusive. And to help bring this, the tech giant has announced a new project called PAIR.


Understanding Agent Cooperation DeepMind

#artificialintelligence

Interestingly, in another game called Wolfpack (see gameplay video below), which requires close coordination to successfully cooperate, we find that greater capacity to implement complex strategies leads to more cooperation between agents, the opposite of the finding with Gathering. So, depending on the situation, having a greater capacity to implement complex strategies may yield either more or less cooperation. The new framework of sequential social dilemmas allows us to take into account not only the outcome of the interaction (as in the Prisoner's dilemma), but also the difficulty of learning to implement a given strategy.