Goto

Collaborating Authors

 Deep Learning


Deep learning godfathers Bengio, Hinton, and LeCun say the field can fix its flaws ZDNet

#artificialintelligence

Artificial intelligence has to go in new directions if it's to realize the machine equivalent of common sense, and three of its most prominent proponents are in violent agreement about exactly how to do that. Yoshua Bengio of Canada's MILA institute, Geoffrey Hinton of the University of Toronto, and Yann LeCun of Facebook, who have called themselves co-conspirators in the revival of the once-moribund field of "deep learning," took the stage Sunday night at the Hilton hotel in midtown Manhattan for the 34th annual conference of the Association for the Advancement of Artificial Intelligence. The three, who were dubbed the "godfathers" of deep learning by the conference, were being honored for having received last year's Turing Award for lifetime achievements in computing. Each of the three scientists got a half-hour to talk, and each one acknowledged numerous shortcomings in deep learning, things such as "adversarial examples," where an object recognition system can be tricked into misidentifying an object just by adding noise to a picture. "There's been a lot of talk of the negatives about deep learning," LeCun noted.


Army looks to block data 'poisoning' in facial recognition, AI - FedScoop

#artificialintelligence

The Army has many data problems. But when it comes to the data that underlies facial recognition, one sticks out: Enemies want to poison the well. Adversaries are becoming more sophisticated at providing "poisoned," or subtly altered, data that will mistrain artificial intelligence and machine learning algorithms. To try and safeguard facial recognition databases from these so-called backdoor attacks, the Army is funding research to build defensive software to mine through its databases. Since deep learning algorithms are only as good as the data they rely on, adversaries can use backdoor attacks to leave the Army with untrustworthy AI or even bake-in the ability to kill an algorithm when it sees a particular image, or "trigger." "People tend to modify the input data very slightly so it is not so obvious to a human eye, but can fool the model," said Helen Li, a Duke University faculty member whose research team received $60,000 from the Army Research Office for work on an AI database defensive software.


Deep Learning Has Limits. But Its Commercial Impact Has Just Begun.

#artificialintelligence

Studies have shown that AI can outperform human doctors at identifying breast cancer from ... [ ] mammograms. Here, a clinician interprets a mammogram in a hospital in France. There has been increased hand-wringing across the AI community in recent months about the limitations of deep learning. It was a dominant theme a few months ago at NeurIPS, the world's premier AI conference. In December, deep learning pioneer Yoshua Bengio and AI researcher Gary Marcus engaged in a high-profile televised debate about whether deep learning was the right path forward for AI.


Recurrent Neural Networks for Electricity Price Prediction

#artificialintelligence

Demand flexibility can be described as the capacity for end users of electricity (think both business and homes) to change their electricity consumption patterns in response to market signals, such as time variable electricity prices. Electricity prices follow daily, weekly and seasonal patterns. Above we can see the daily pattern. In the morning, everyone wakes up, turns all their devices on and prices rise. As the population goes off to work, demand and prices fall (and solar generation comes online).


AI still doesn't have the common sense to understand human language

#artificialintelligence

Until pretty recently, computers were hopeless at producing sentences that actually made sense. But the field of natural-language processing (NLP) has taken huge strides, and machines can now generate convincing passages with the push of a button. These advances have been driven by deep-learning techniques, which pick out statistical patterns in word usage and argument structure from vast troves of text. But a new paper from the Allen Institute of Artificial Intelligence calls attention to something still missing: machines don't really understand what they're writing (or reading). This is a fundamental challenge in the grand pursuit of generalizable AI--but beyond academia, it's relevant for consumers, too. Chatbots and voice assistants built on state-of-the-art natural-language models, for example, have become the interface for many financial institutions, health-care providers, and government agencies.


ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters - Microsoft Research

#artificialintelligence

The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. Microsoft is releasing an open-source library called DeepSpeed, which vastly advances large model training by improving scale, speed, cost, and usability, unlocking the ability to train 100-billion-parameter models. One piece of that library, called ZeRO, is a new parallelized optimizer that greatly reduces the resources needed for model and data parallelism while massively increasing the number of parameters that can be trained. Researchers have used these breakthroughs to create Turing Natural Language Generation (Turing-NLG), the largest publicly known language model at 17 billion parameters, which you can learn more about in this accompanying blog post. The Zero Redundancy Optimizer (abbreviated ZeRO) is a novel memory optimization technology for large-scale distributed deep learning.


Microsoft trains world's largest Transformer language model

#artificialintelligence

Microsoft AI & Research today shared what it calls the largest Transformer-based language generation model ever and open-sourced a deep learning library named DeepSpeed to make distributed training of large models easier. At 17 billion parameters, Turing NLG is twice the size of Nvidia's Megatron, now the second biggest Transformer model, and includes 10 times as many parameters as OpenAI's GPT-2. Turing NLG achieves state-of-the-art results on a range of NLP tasks. Like Google's Meena and initially with GPT-2, at first Turing NLG may only be shared in private demos. Language generation models with the Transformer architecture predict the word that comes next.


Complete Machine Learning with R Studio - ML for 2020

#artificialintelligence

Online Courses Udemy - Complete Machine Learning with R Studio - ML for 2020, Linear & Logistic Regression, Decision Trees, XGBoost, SVM & other ML models in R programming language - R studio 4.1 (41 ratings), Created by Start-Tech Academy, English [Auto-generated] Preview this Udemy course -. GET COUPON CODE Description In this course we will learn and practice all the services of AWS Machine Learning which is being offered by AWS Cloud. There will be both theoretical and practical section of each AWS Machine Learning services.This course is for those who loves machine learning and would build application based on cognitive computing, AI and ML. You could integrate these services in your Web, Android, IoT, Desktop Applications like Face Detection, ChatBot, Voice Detection, Text to custom Speech (with pitch, emotions, etc), Speech to text, Sentimental Analysis on Social media or any textual data. Machine Learning Services like- Amazon Sagemaker to build, train, and deploy machine learning models at scale Amazon Comprehend for natural Language processing and text analytics Amazon Lex for conversational interfaces for your applications powered by the same deep learning technologies as Alexa Amazon Polly to turn text into lifelike speech using deep learning Object and scene detection,Image moderation,Facial analysis,Celebrity recognition,Face comparison,Text in image and many more Amazon Transcribe for automatic speech recognition Amazon Translate for natural and accurate language translation As Machine learning and cloud computing are trending topic and also have lot of job opportunities If you have interest in machine learning as well as cloud computing then this course for you.


Build a unique Brand Voice with Amazon Polly Amazon Web Services

#artificialintelligence

AWS is pleased to announce a new feature in Amazon Polly called Brand Voice, a capability in which you can work with the Amazon Polly team of AI research scientists and linguists to build an exclusive, high-quality, Neural Text-to-Speech (NTTS) voice that represents your brand's persona. Brand Voice allows you to differentiate your brand by incorporating a unique vocal identity into your products and services. Amazon Polly has been working with Kentucky Fried Chicken (KFC) Canada and National Australia Bank (NAB) to create two unique Brand Voices, using the same deep learning technology that powers the voice of Alexa. The Amazon Polly team has built a voice for KFC Canada in a Southern US English accent for the iconic Colonel Sanders to voice KFC's latest Alexa skill. The voice-activated skill available through any Alexa-enabled Amazon device allows KFC lovers in Canada to chat all things chicken with Colonel Sanders himself, including re-ordering their favorite KFC.


A Physiology-Driven Computational Model for Post-Cardiac Arrest Outcome Prediction

arXiv.org Machine Learning

Patients resuscitated from cardiac arrest (CA) face a high risk of neurological disability and death, however pragmatic methods are lacking for accurate and reliable prognostication. The aim of this study was to build computational models to predict post-CA outcome by leveraging high-dimensional patient data available early after admission to the intensive care unit (ICU). We hypothesized that model performance could be enhanced by integrating physiological time series (PTS) data and by training machine learning (ML) classifiers. We compared three models integrating features extracted from the electronic health records (EHR) alone, features derived from PTS collected in the first 24hrs after ICU admission (PTS24), and models integrating PTS24 and EHR. Outcomes of interest were survival and neurological outcome at ICU discharge. Combined EHR-PTS24 models had higher discrimination (area under the receiver operating characteristic curve [AUC]) than models which used either EHR or PTS24 alone, for the prediction of survival (AUC 0.85, 0.80 and 0.68 respectively) and neurological outcome (0.87, 0.83 and 0.78). The best ML classifier achieved higher discrimination than the reference logistic regression model (APACHE III) for survival (AUC 0.85 vs 0.70) and neurological outcome prediction (AUC 0.87 vs 0.75). Feature analysis revealed previously unknown factors to be associated with post-CA recovery. Results attest to the effectiveness of ML models for post-CA predictive modeling and suggest that PTS recorded in very early phase after resuscitation encode short-term outcome probabilities.