Deep Learning
Media synthesis and personalized content: my epiphany on GANs • r/artificial
Remember when Hayao Miyazaki called an AI-created animation "an insult to life itself?" The cold fact is that it's not going away. If anything, we're on the cusp of an era where AI-created media is dominant. Nvidia's new AI creates disturbingly convincing fake videos Researchers from Nvidia have created an image translation AI that will almost certainly have you second-guessing everything you see online. The system can change day into night, winter into summer, and house cats into cheetahs with minimal training materials.
[News] New NVIDIA EULA prohibits Deep Learning on GeForce GPUs in data centers. • r/MachineLearning
I would assume that's vague on purpose. When in doubt, NVIDIA can call your school lab's two PCs locked in a closet a "data center" and send you a nastygram. Also, this is ridiculous and shows that the Free Software Foundation had a point a few decades ago about how important free/OSS is, as otherwise companies would try to control what we are allowed to use their software for. The biggest red flag here is not that they forbid you to use their software in data centers. The biggesr red flag is that they presume to dictate what purpose you are allowed to use the software for.
[P] Going Deeper: Infinite Deep Neural Networks • r/MachineLearning
The described "meta-layer" with infinite many sub-layers has a ResNet-like structure (see Figure 3 on page 5 on the linked github page). This means every sub-layer has a structure like f(x) x g(x). Every new added layer, therefore, has this structure. To make the process of adding layers smoother there is a factor "d" between 0 and 1 added to this layer-defintion: f(x) x d*g(x). Usually "adding" (more correct: activating; because the model assumes that there are from the beginning infinite many layers) a new layer requires multiple iterations where "d" grows from 0 up to a value smaller than 1 (the limit is 1). Therefore, if a new layer is added, the value of "d" is very small, e.g.
Nvidia changed EULA - no deep learning on geforce gpus in datacenters • r/deeplearning
I feel as if this could be a good thing. It would keep the price down for the general consumer market. Else I'd fear supply/demand could drive the GTX1180 to be a $1000 card. It sucks because their price to performance ratio is way higher, but consumers can't afford the same as what corporations can.
Deep Learning for NLP, advancements and trends in 2017 - Tryolabs Blog
Over the past few years, Deep Learning (DL) architectures and algorithms have made impressive advances in fields such as image recognition and speech processing. Their application to Natural Language Processing (NLP) was less impressive at first, but has now proven to make significant contributions, yielding state-of-the-art results for some common NLP tasks. Named entity recognition (NER), part of speech (POS) tagging or sentiment analysis are some of the problems where neural network models have outperformed traditional approaches. The progress in machine translation is perhaps the most remarkable among all. In this article I will go through some advancements for NLP in 2017 that rely on DL techniques.
Flipboard on Flipboard
While the number of headlines about machine learning might lead one to think that we just discovered something profoundly new, the reality is that the technology is nearly as old as computing. It's no coincidence that Alan Turing, one of the most influential computer scientists of all time, started his 1950 treatise on computing with the question "Can machines think?" From our science fiction to our research labs, we have long questioned whether the creation of artificial versions of ourselves will somehow help us uncover the origin of our own consciousness, and more broadly, our role on earth. Unfortunately, the learning curve on AI is really damn steep. By tracing a bit of history, we should hopefully be able to get to the bottom of wtf machine learning really is.
10 things you didn't know your Amazon Echo could do
The Echo family of smart speakers is central to Amazon's consumer-facing deep-learning technology. Did you just unwrap a shiny, new Amazon Echo device? Or maybe you already have one and you're getting a little tired just streaming endless hours of holiday music. You might already know that Alexa can convert teaspoons to tablespoons, time the food you put in the oven and tell jokes you can repeat at work. But the digital assistant in Amazon's Echo speakers is capable of so much more.
Convolutional Neural Networks: Zero to Full Real-World Apps
Get your team access to Udemy's top 2,000 courses anytime, anywhere. You'll start with the Neural Networks Review: You'll start your Convolutional Neural Networks endeavor by reviewing their history and motivation: You'll continue your Convolutional Neural Networks endeavor by going into all required concepts: Before jumping into code, you'll see some Convolutional Neural Networks action: Now it's time for you to code your own Convolutional Neural Networks app with your own images: Lastly, you can post questions or doubts, and I'll answer to you personally. Want to know how to navigate this course? For easier and prettier coding, install this Python IDE. You can work faster in PyCharm using these hotkeys, I'll use them in the course too This is the best stack for CNNs!
CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
Rajpurkar, Pranav, Irvin, Jeremy, Zhu, Kaylie, Yang, Brandon, Mehta, Hershel, Duan, Tony, Ding, Daisy, Bagul, Aarti, Langlotz, Curtis, Shpanskaya, Katie, Lungren, Matthew P., Ng, Andrew Y.
We develop an algorithm that can detect pneumonia from chest X-rays at a level exceeding practicing radiologists. Our algorithm, CheXNet, is a 121-layer convolutional neural network trained on ChestX-ray14, currently the largest publicly available chest X-ray dataset, containing over 100,000 frontal-view X-ray images with 14 diseases. Four practicing academic radiologists annotate a test set, on which we compare the performance of CheXNet to that of radiologists. We find that CheXNet exceeds average radiologist performance on the F1 metric. We extend CheXNet to detect all 14 diseases in ChestX-ray14 and achieve state of the art results on all 14 diseases.
Deep learning from crowds
Rodrigues, Filipe, Pereira, Francisco
Over the last few years, deep learning has revolutionized the field of machine learning by dramatically improving the state-of-the-art in various domains. However, as the size of supervised artificial neural networks grows, typically so does the need for larger labeled datasets. Recently, crowdsourcing has established itself as an efficient and cost-effective solution for labeling large sets of data in a scalable manner, but it often requires aggregating labels from multiple noisy contributors with different levels of expertise. In this paper, we address the problem of learning deep neural networks from crowds. We begin by describing an EM algorithm for jointly learning the parameters of the network and the reliabilities of the annotators. Then, a novel general-purpose crowd layer is proposed, which allows us to train deep neural networks end-to-end, directly from the noisy labels of multiple annotators, using only backpropagation. We empirically show that the proposed approach is able to internally capture the reliability and biases of different annotators and achieve new state-of-the-art results for various crowdsourced datasets across different settings, namely classification, regression and sequence labeling.