Deep Learning
Things get weird when a neural net is trained on text adventure games
The answer is pretty weird. Shane aptly describes the experience as "dreamlike," with the setting frequently, and seemingly without reason, changing from scene to scene. For example, in one playthrough, the AI opened the game with a scene set in space only then to quickly transition things to a "labyrinth of twisty little passages, all alike." If there's a throughline to many of the scenarios, it's Zork, one of the games used to train the neural net and a classic in the genre. The AI will frequently call on the 40-year-old game to react to the player, more often than not presenting trolls as an obstacle to progress.
r/MachineLearning - [N] Open-Unmix for Music Separation
It is our great pleasure to announce the release of Open-unmix, a MIT-licensed python implementation for DNN-based music separation. In the recent years, deep learning-based systems could break a long-standing crystal ceiling, and finally allow high-quality music separation. However, until now, no open-source implementation was available that matches the performance of the best systems proposed more than four years ago. Not being able to reproduce state of the art performance makes it difficult to clearly identify the sources for discrepancies and rooms for improvement. In this context, we release Open-Unmix (UMX) as closing this gap by providing a reference implementation for DNN-based music separation.
r/MachineLearning - [P] learn2learn: A PyTorch Meta Learning Library
We are pleased to share with you our meta-learning library, that started as a project at the PyTorch hackathon. Our goal is to support as many meta-learning algorithms as possible (be it few-shots, meta-descent, or meta-RL) and to enable researchers to develop better methods and easily compare against existing literature. Modular API: implement your own training loops with our low-level utilities. Let us know what you think and how we can help you in your research! PS: learn2learn was also accepted as a poster to the PyTorch Dev Conference, so you'll know all about it there!
What is deep learning (deep neural network)? - Definition from WhatIs.com
Each algorithm in the hierarchy applies a nonlinear transformation on its input and uses what it learns to create a statistical model as output. Iterations continue until the output has reached an acceptable level of accuracy. The number of processing layers through which data must pass is what inspired the label deep. In traditional machine learning, the learning process is supervised and the programmer has to be very, very specific when telling the computer what types of things it should be looking for when deciding if an image contains a dog or does not contain a dog. This is a laborious process called feature extraction and the computer's success rate depends entirely upon the programmer's ability to accurately define a feature set for "dog."
Neural Network for Satellite Data Classification Using Tensorflow in Python
Deep Learning has taken over the majority of fields in solving complex problems, and the geospatial field is no exception. The title of the article interests you and hence, I hope that you are familiar with satellite datasets; for now, Landsat 5 TM. Little knowledge of how Machine Learning (ML) algorithms work, will help you grasp this hands-on tutorial quickly. For those who are unfamiliar with ML concept, in a nutshell, it is establishing the relationship between a few characteristics (features or Xs) of an entity with its other property (value or label or Y) -- we provide plenty of examples (labelled data) to the model so that it learns from it and then predicts values/ labels for the new data (unlabelled data). That is enough of theory brush-up for machine learning!
O'Reilly Artificial Intelligence Conference 2019 - San Jose, California
Keynote addresses from AI thought leaders such as Andrew Feldman (Cerebras Systems), Sahika Genc (AWS DeepRacer/SageMaker RL), MikeJordan (UC Berkeley), and Andrew Zaldivar (AI Google). Unrestricted access to the exclusive AI Business Summit's executive briefings, best practice sessions, and tutorials led by AI business pros such as Michael Radwin (Intuit), Bahman Bahmani (Rakuten), Mayukh Bhaowal (Salesforce Einstein), Yael Gozin (Pfizer), and James Manyika (McKinsey & Company). Deep dive tutorials, including Jason Dai (Intel) on building deep learning apps for big data with the Analytics Zoo AI platform; Chaoran Yu (Lightbend) on doing machine learning (ML) with Kafka-based streaming pipelines; and Justina Petraityte (Rasa) on developing intelligent AI assistants based entirely on ML with open source Rasa NLU and Rasa Core. Sessions devoted to AI Implementation, such as Anuradha Gali (Uber) on using AI to leverage 15 million trips a day on the Uber platform; Roshan Sumbaly (Facebook) on connecting the dots between the software engineering and ML development worlds; Paige Bailey's (Google) on TensorFlow 2.0's new features; and Alex Ratner (Snorkel) on building and managing training datasets for ML with open source Snorkel. Sessions focused on AI Models & Methods, including Lukas Biewald (Weights & Biases) review of how to use Keras to classify text with LSTMs and other ML techniques; and Francesca Lazzeri (Microsoft) on using AutoML to automate ML model selection and hyperparameter tuning.
Development and Validation of a Deep Learning System to Detect Glaucomatous Optic Neuropathy
Question How does a deep learning system compare with professional human graders in detecting glaucomatous optic neuropathy? Findings In this cross-sectional study, the deep learning system showed a sensitivity and specificity of greater than 90% for detecting glaucomatous optic neuropathy in a local validation dataset, in 3 clinical-based datasets, and in a real-world distribution dataset. The deep learning system showed lower sensitivity when tested in multiethnic and website-based datasets. Meaning This assessment of fundus images suggests that deep learning systems can provide a tool with high sensitivity and specificity that might expedite screening for glaucomatous optic neuropathy. Importance A deep learning system (DLS) that could automatically detect glaucomatous optic neuropathy (GON) with high sensitivity and specificity could expedite screening for GON. Objective To establish a DLS for detection of GON using retinal fundus images and glaucoma diagnosis with convoluted neural networks (GD-CNN) that has the ability to be generalized across populations. Design, Setting, and Participants In this cross-sectional study, a DLS for the classification of GON was developed for automated classification of GON using retinal fundus images obtained from the Chinese Glaucoma Study Alliance, the Handan Eye Study, and online databases.
Nvidia AI research points to an evolution of the chip business 7wData
What happens as more of the world's computer tasks get handed over to neural networks? That's an intriguing prospect, of course, for Nvidia, a company selling a whole heck of a lot of chips to train neural networks. The prospect cheers Bryan Catanzaro, who is the head of applied deep learning research at Nvidia. "We would love for model-based to be more of the workload," Catanzaro told ZDNetthis week during an interview at Nvidia's booth at the NeurIPS machine learning conference in Montreal. Catanzaro was the first person doing neural network work at Nvidia when he took a job there in 2011 after receiving his PhD from the University of California at Berkeley in electrical engineering and computer science.
Nvidia AI research points to an evolution of the chip business 7wData
What happens as more of the world's computer tasks get handed over to neural networks? That's an intriguing prospect, of course, for Nvidia, a company selling a whole heck of a lot of chips to train neural networks. The prospect cheers Bryan Catanzaro, who is the head of applied deep learning research at Nvidia. "We would love for model-based to be more of the workload," Catanzaro told ZDNetthis week during an interview at Nvidia's booth at the NeurIPS machine learning conference in Montreal. Catanzaro was the first person doing neural network work at Nvidia when he took a job there in 2011 after receiving his PhD from the University of California at Berkeley in electrical engineering and computer science.