Goto

Collaborating Authors

 Deep Learning


Automated machine learning or AutoML explained

#artificialintelligence

The two biggest barriers to the use of machine learning (both classical machine learning and deep learning) are skills and computing resources. You can solve the second problem by throwing money at it, either for the purchase of accelerated hardware (such as computers with high-end GPUs) or for the rental of compute resources in the cloud (such as instances with attached GPUs, TPUs, and FPGAs). On the other hand, solving the skills problem is harder. Data scientists often command hefty salaries and may still be hard to recruit. Google was able to train many of its employees on its own TensorFlow framework, but most companies barely have people skilled enough to build machine learning and deep learning models themselves, much less teach others how.


Accelerate with BERT: NLP Optimization Models

#artificialintelligence

There are two primary difficulties when building deep learning natural language processing (NLP) classification models. Our ability to build complex deep learning models that are capable of understanding the complexity of language has typically required years of experience across these domains. The harder your problem, the more diverse your output, the more time you need to spend on each of these steps. Data collection is burdensome, time-consuming, expensive, and is the number one limiting factor for successful NLP projects. Preparing data, building resilient pipelines, making choices amongst hundreds of potential preparation options, and getting "model ready" can easily take months of effort even with talented machine learning engineers.


OpenAI has released the largest version yet of its fake-news-spewing AI

#artificialintelligence

Full model-generated text:"It is time once again. I believe this nation can do great things if the people make their voices heard. The men and women of America must once more summon our best elements, all our ingenuity, and find a way to turn such overwhelming tragedy into the opportunity for a greater good and the fulfillment of all our dreams. In the months and years to come, there will be many battles in which we will have to be strong and we must give all of our energy, not to repel invaders, but rather to resist aggression and to win the freedom and the equality for all of our people. The destiny of the human race hangs in the balance; we cannot afford for it to slip away. Now and in the years to come, the challenge before us is to work out how we achieve our ultimate destiny. If we fail to do so, we are doomed."


What Does The Future Hold For AI? Five Predictions

#artificialintelligence

Deep learning has been immensely successful in solving perception problems, particularly when there are large supervised (that is to say, labeled) data sets available. This is the technique that has given us amazing image and handwriting recognition, language translation and much more. However, the need for massive amounts of labeled data can be a problem in the real world. For example, AI can work with industrial systems. In order to protect companies, AI can predict when a large industrial asset such as a turbine might fail in the real world.


On Education PyTorch for Deep Learning and Computer Vision - all courses

#artificialintelligence

Implement Machine and Deep Learning applications with PyTorch Build Neural Networks from scratch Build complex models through the applied theme of Advanced Imagery and Computer Vision Solve complex problems in Computer Vision by harnessing highly sophisticated pre-trained models Use style transfer to build sophisticated AI applications No experience is required PyTorch has rapidly become one of the most transformative frameworks in the field of Deep Learning. Since its release, PyTorch has completely changed the landscape in the field of deep learning due to its flexibility, and how easy it is to use when building Deep Learning models. Deep Learning jobs command some of the highest salaries in the development world. This course is meant to take you from the complete basics, to building state-of-the art Deep Learning and Computer Vision applications with PyTorch. With over 44000 students, Rayan is a highly rated and experienced instructor who has followed a "learn by doing" style to create this amazing course.


r/MachineLearning - [P] Multipart Tutorial on Graph Neural Networks for Computer Vision and Beyond with PyTorch examples

#artificialintelligence

I published a multipart "Tutorial on Graph Neural Networks for Computer Vision and Beyond" starting from some basics [1], then an overview explaining several important methods [2] and a separate post on spectral convolution [3]. I know there are a lot of blog posts on graph networks already, but in my tutorial I tried to explain key (and sometimes complicated) ideas in very simple terms from a computer vision perspective, so it should be good for those with a computer vision and machine learning background. I provide detailed Python and PyTorch examples to clarify differences between methods. Otherwise, feel free to downvote or remove. Any questions or feedback is very welcome, especially, if you notice some mistakes or confusing info.


r/MachineLearning - [R] All-Optical Neural Network For Deep Learning

#artificialintelligence

Abstract: Artificial neural networks (ANNs) have now been widely used for industry applications and also played more important roles in fundamental researches. Although most ANN hardware systems are electronically based, optical implementation is particularly attractive because of its intrinsic parallelism and low energy consumption. Here, we propose and demonstrate fully-functioned all optical neural networks (AONNs), in which linear operations are programmed by spatial light modulators and Fourier lenses, and optical nonlinear activation functions are realized with electromagnetically induced transparency in laser-cooled atoms. Moreover, all the errors from different optical neurons here are independent, thus the AONN could scale up to a larger system size with final error still maintaining in a similar level of a single neuron. We confirm its capability and feasibility in machine learning by successfully classifying the order and disorder phases of a typical statistic Ising model.


OpenAI Said Its Code Was Risky. Two Grads Re-Created It Anyway

#artificialintelligence

In February, an artificial intelligence lab cofounded by Elon Musk informed the world that its latest breakthrough was too risky to release to the public. OpenAI claimed it had made language software so fluent at generating text that it might be adapted to crank out fake news or spam. On Thursday, two recent master's graduates in computer science released what they say is a re-creation of OpenAI's withheld software onto the internet for anyone to download and use. Aaron Gokaslan, 23, and Vanya Cohen, 24, say they aren't out to cause havoc and don't believe such software poses much risk to society yet. The pair say their release was intended to show that you don't have to be an elite lab rich in dollars and PhDs to create this kind of software: They used an estimated $50,000 worth of free cloud computing from Google, which hands out credits to academic institutions.


A 2019 Guide to Speech Synthesis with Deep Learning

#artificialintelligence

The authors of this paper are from Google. They present a neural network for generating raw audio waves. Their model is fully probabilistic and autoregressive, and it generates state-of-the-art text-to-speech results for both English and Mandarin. WaveNet is an audio generative model based on the PixelCNN. In this generative model, each audio sample is conditioned on the previous audio sample.


Researchers demonstrate all-optical neural network for deep learning

#artificialintelligence

Even the most powerful computers are still no match for the human brain when it comes to pattern recognition, risk management, and other similarly complex tasks. Recent advances in optical neural networks, however, are closing that gap by simulating the way neurons respond in the human brain. In a key step toward making large-scale optical neural networks practical, researchers have demonstrated a first-of-its-kind multilayer all-optical artificial neural network. Generally, this type of artificial intelligence can tackle complex problems that are impossible with traditional computational approaches, but current designs require extensive computational resources that are both time-consuming and energy intensive. For this reason, there is great interest developing practical optical artificial neural networks, which are faster and consume less power than those based on traditional computers.