Deep Learning
r/MachineLearning - [P] First videos and blogs for new Deep Learning with PyTorch series now available!
This means that certain aspects of PyTorch are hidden for convenience. This makes certain routines easier and adds additional functionality but introduces an additional layer of abstraction. This series starts with PyTorch at the bottom and moves upward (bottom up approach), so it's really a matter of preference for both the course and the library. The general suggestion is to use both courses as learning resources, and to learn pure PyTorch as well as the fast.ai
r/deeplearning - How can I understand the maths of back propagation of neural network, CNN and RNN?
I'm currently writing a series of blog posts aimed at demystifying the maths behind deep learning. I've gone through the intuition as well as step-by-step through the maths, and I've also got code samples for you to implement the neural networks from scratch. Hope you find the posts useful, please comment if there are parts that could be made clearer. I'll be posting the RNN/LSTM backprop posts in a few days, in the meantime I have already posted the CNN and neural network backprop posts if you want to check that out.
r/deeplearning - How to become deep learning researcher?
If you aim to become deep learning researcher then you should lean things more deeply then just their implementation part. I would advice to start working on some project along with the reading stuff. A good knowledge of these concepts is required for reading research paper. Then learn basic ML stuff and deep learning concept. Doing this course will give you sufficient knowledge about the basic architectures of deep learning.
r/deeplearning - New exciting Deep learning Project !!!
I was looking for some cool deep leaning project. Could any one suggest me list of new deep learning project, that I can work on from scratch. May be more related to the language, but every suggestion is welcomed. I was thinking of work on some research on Machine Translation Using Monolingual Corpora. If interested ping me, personally we could discuss.
7 factors that will push implementation of AI in healthcare
Additionally, Naylor explained that while AI and deep learning serve as an analytic and modeling tool, they also represent the current convergence of health and data sciences. "Barriers to adoption will rightly be more rigid in healthcare than in many other fields in which software programs relying on deep learning and other forms of machine learning are used daily by billions of people," Naylor wrote. "However, pressure to deploy deep learning and a range of tools derived from modern data science will be relentless, given the extraordinarily rich information now available to characterize and follow vast numbers of patients, the ongoing challenges of making sense of the complexity of human biology and healthcare systems, and the potential for smart information technology to support tomorrow's clinicians in the provision of safe, effective, efficient and humanistic care." In a partnering viewpoint, Geoffrey Hinton, PhD, a cognitive psychologist and computer scientist with Google's Brain Team and University of Toronto, explained that deep learning has undoubtedly changed the healthcare landscape, especially in image interpretation, speech recognition and language translation. Because artificial neural networks of deep learning mirror the brain's ability to learn difficult patterns, Hinton noted that the networks also model complicated between inputs and outputs used for predicting future medical events from past events or large data sets.
Microsoft acquires Lobe, an AI startup working on easy-to-use deep-learning development tools
Artificial intelligence tools will never be widely used if it takes decades of expertise to put them into action, which is why cloud companies have been working hard to make them easier to use and more accessible. Microsoft took another step in that direction Thursday with the acquisition of San Francisco-based Lobe. Terms of the deal were not disclosed in a blog post written by Kevin Scott, Microsoft's executive vice president and chief technology officer, announcing the acquisition. Founded by Mike Matas, Adam Menges, and Markus Beissinger in 2015, Lobe created visual tools that can build deep-learning models with a drag-and-drop user interface, rather than lines of code. Lobe will continue to operate its service under Microsoft, according to its web site.
Deep Learning for NLP: An Overview of Recent Trends
In a timely new paper, Young and colleagues discuss some of the recent trends in deep learning based natural language processing (NLP) systems and applications. The focus of the paper is on the review and comparison of models and methods that have achieved state-of-the-art (SOTA) results on various NLP tasks such as visual question answering (QA) and machine translation. In this comprehensive review, the reader will get a detailed understanding of the past, present, and future of deep learning in NLP. In addition, readers will also learn some of the current best practices for applying deep learning in NLP. Natural language processing (NLP) deals with building computational algorithms to automatically analyze and represent human language. NLP-based systems have enabled a wide range of applications such as Google's powerful search engine, and more recently, Amazon's voice assistant named Alexa.
Simple diagrams of convoluted neural networks – InBrowserAI – Medium
Neural networks are complicated, multidimensional, nonlinear array operations. How can we present a deep learning model architecture in a way that shows key features, while avoiding being too complex or repetitive? How can we present them in a way that is clear, didactic and insightful? Right now, there is no standard for plots -- neither for research nor didactic projects. Let me take you through an overview of tools and techniques for visualizing whole networks and particular blocks! AlexNet was a breakthrough architecture, setting convolutional networks (CNNs) as the leading machine learning algorithm for large image classification.
Development of deep learning algorithms to categorize free-text notes pertaining to diabetes: convolution neural networks achieve higher accuracy than support vector machines
Health professionals can use natural language processing (NLP) technologies when reviewing electronic health records (EHR). Machine learning free-text classifiers can help them identify problems and make critical decisions. We aim to develop deep learning neural network algorithms that identify EHR progress notes pertaining to diabetes and validate the algorithms at two institutions. The data used are 2,000 EHR progress notes retrieved from patients with diabetes and all notes were annotated manually as diabetic or non-diabetic. Several deep learning classifiers were developed, and their performances were evaluated with the area under the ROC curve (AUC). The convolutional neural network (CNN) model with a separable convolution layer accurately identified diabetes-related notes in the Brigham and Womens Hospital testing set with the highest AUC of 0.975. Deep learning classifiers can be used to identify EHR progress notes pertaining to diabetes. In particular, the CNN-based classifier can achieve a higher AUC than an SVM-based classifier.
MeshCNN: A Network with an Edge
Hanocka, Rana, Hertz, Amir, Fish, Noa, Giryes, Raja, Fleishman, Shachar, Cohen-Or, Daniel
A polygonal mesh representation provides an efficient approximation for 3D shapes. It explicitly captures both shape surface and topology, and leverages non-uniformity to represent large flat regions as well as sharp, intricate features. This non-uniformity and irregularity, however, inhibits mesh analysis efforts using neural networks that combine convolution and pooling operations. In this paper, we utilize the unique properties of the mesh for a direct analysis of 3D shapes using MeshCNN, a convolutional neural network designed specifically for triangular meshes. Analogous to classic CNNs, MeshCNN combines specialized convolution and pooling layers that operate on the mesh edges, by leveraging their intrinsic geodesic connections. Convolutions are applied on edges and the four edges of their incident triangles, and pooling is applied via an edge collapse operation that retains surface topology, thereby, generating new mesh connectivity for the subsequent convolutions. MeshCNN learns which edges to collapse, thus forming a task-driven process where the network exposes and expands the important features while discarding the redundant ones. We demonstrate the effectiveness of our task-driven pooling on various learning tasks applied to 3D meshes.