Deep Learning
Artificial intelligence to generate new cancer drugs on demand Scienmag: Latest Science and Health News
The study was published in Oncotarget on 22nd of December, 2016. The study represents the proof of concept for applying Generative Adversarial Networks (GANs) to drug discovery. The authors significantly extended this model to generate new leads according to multiple requested characteristics and plan to launch a comprehensive GAN-based drug discovery engine producing promising therapeutic treatments to significantly accelerate pharmaceutical R&D and improve the success rates in clinical trials. Since 2010 deep learning systems demonstrated unprecedented results in image, voice and text recognition, in many cases surpassing human accuracy and enabling autonomous driving, automated creation of pleasant art and even composition of pleasant music. GAN is a fresh direction in deep learning invented by Ian Goodfellow in 2014.
Multivariate Industrial Time Series with Cyber-Attack Simulation: Fault Detection Using an LSTM-based Predictive Data Model
Filonov, Pavel, Lavrentyev, Andrey, Vorontsov, Artem
We adopted an approach based on an LSTM neural network to monitor and detect faults in industrial multivariate time series data. To validate the approach we created a Modelica model of part of a real gasoil plant. By introducing hacks into the logic of the Modelica model, we were able to generate both the roots and causes of fault behavior in the plant. Having a self-consistent data set with labeled faults, we used an LSTM architecture with a forecasting error threshold to obtain precision and recall quality metrics. The dependency of the quality metric on the threshold level is considered. An appropriate mechanism such as "one handle" was introduced for filtering faults that are outside of the plant operator field of interest.
Steerable CNNs
It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and flexible class of equivariant convolutional networks. We show that steerable CNNs achieve state of the art results on the CIFAR image classification benchmark. The mathematical theory of steerable representations reveals a type system in which any steerable representation is a composition of elementary feature types, each one associated with a particular kind of symmetry. We show how the parameter cost of a steerable filter bank depends on the types of the input and output features, and show how to use this knowledge to construct CNNs that utilize parameters effectively.
A Deep Learning Tutorial: From Perceptrons to Deep Networks
We have some algorithm that's given a handful of labeled examples, say 10 images of dogs with the label 1 ("Dog") and 10 images of other things with the label 0 ("Not dog")--note that we're mainly sticking to supervised, binary classification for this post. The algorithm "learns" to identify images of dogs and, when fed a new image, hopes to produce the correct label (1 if it's an image of a dog, and 0 otherwise). We have some algorithm that's given a handful of labeled examples, say 10 images of dogs with the label 1 ("Dog") and 10 images of other things with the label 0 ("Not dog")--note that we're mainly sticking to supervised, binary classification for this post. The algorithm "learns" to identify images of dogs and, when fed a new image, hopes to produce the correct label (1 if it's an image of a dog, and 0 otherwise). This setting is incredibly general: your data could be symptoms and your labels illnesses; or your data could be images of handwritten characters and your labels the actual characters they represent.
Catdiology? Cat pictures are helping AI get better at recognizing X-rays
It's easy to joke that the internet was invented to give people around the world the opportunity to share pictures of cats. However, according to a new report, those kitty pictures may one day turn out to save your life. That is based on work being done by Dr. Alvin Rajkomar, an assistant professor at the University of California, San Francisco Medical Center. Rajkomar trained a deep learning neural network to be able to automatically detect life-threatening abnormalities in chest X-rays. "When I was a medical resident, I ordered a stat X-ray of a patient who I suspected had a life-threatening pneumothorax -- air outside of his lung compressing his heart -- and happened to be standing next to the digital X-ray machine as it was being taken," he told Digital Trends.
Creating machines that understand language is AI's next big challenge
About halfway through a particularly tense game of Go held in Seoul, South Korea, between Lee Sedol, one of the best players of all time, and AlphaGo, an artificial intelligence created by Google, the AI program made a mysterious move that demonstrated an unnerving edge over its human opponent. On move 37, AlphaGo chose to put a black stone in what seemed, at first, like a ridiculous position. It looked certain to give up substantial territory--a rookie mistake in a game that is all about controlling the space on the board. Two television commentators wondered if they had misread the move or if the machine had malfunctioned somehow. In fact, contrary to any conventional wisdom, move 37 would enable AlphaGo to build a formidable foundation in the center of the board. The Google program had effectively won the game using a move that no human would've come up with. One reason that understanding language is so difficult for computers and AI systems is that words often have meanings based on context and even the appearance of the letters and words. In the images that accompany this story, several artists demonstrate the use of a variety of visual clues to convey meanings far beyond the actual letters.
We chat with deep learning company, Skymind, about the future of AI
As AI integration becomes more prominent, one can't help but to think about just how intelligent deep learning technology will be in the future. One of the first place many of our minds go is to AI becoming too intelligent and taking matters into its own virtual hands. How accurate are those portrayals, though? Will it get to a point where we're overpowered by AI, to the point where we're under their metaphorical thumb? TNW Conference is back for its 12th year.
30 Top Videos, Tutorials & Courses on Machine Learning & Artificial Intelligence from 2016 7wData
We have seen the likes of Google, Facebook, Amazon and many more come out in open and acknowledge the impact machine learning and deep learning had on their business. Last week, I published top videos on deep learning from 2016. I was blown away by the response. I could understand the response to some degree – I found these videos extremely helpful. So, I decided to do a similar article on top videos on machine learning from 2016.
First Deep Learning for coders MOOC launched by Jeremy Howard
Jeremy P. Howard, @JeremyPHoward, is a leading Machine Learning and Deep learning researcher and entrepreneur. His current startup is fast.ai Previously, he was CEO and founder of Enlitic, Kaggle President, and #1 ranked Kaggle competitor. Jeremy initiatives attracts a lot of attention in the industry, so I was very interested to learn from him about his latest project, a first Deep Learning for coders MOOC at course.fast.ai. The course is totally free and includes no advertising - Jeremy created it purely as a service to the community.
2016: The Year That Deep Learning Took Over the Internet
On the west coast of Australia, Amanda Hodgson is launching drones out towards the Indian Ocean so that they can photograph the water from above. The photos are a way of locating dugongs, or sea cows, in the bay near Perth--part of an effort to prevent the extinction of these endangered marine mammals. The trouble is that Hodgson and her team don't have the time needed to examine all those aerial photos. There are too many of them--about 45,000--and spotting the dugongs is far too difficult for the untrained eye. Deep learning is remaking Google, Facebook, Microsoft, and Amazon.