Goto

Collaborating Authors

 Deep Learning


This Chip for AI Works Using Light, Not Electrons

#artificialintelligence

As demand for artificial intelligence grows, so does hunger for the computer power needed to keep AI running. Lightmatter, a startup born at MIT, is betting that AI's voracious hunger will spawn demand for a fundamentally different kind of computer chip--one that uses light to perform key calculations. "Either we invent new kinds of computers to continue," says Lightmatter CEO Nick Harris, "or AI slows down." Conventional computer chips work by using transistors to control the flow of electrons through a semiconductor. By reducing information to a series of 1s and 0s, these chips can perform a wide array of logical operations, and power complex software.


How to tune hyper-params with fixed seeds using PyTorch Lightning and Aim

#artificialintelligence

The random seed is a number that's used to initialize the pseudorandom number generator. It can have a huge impact on the training results. There are different ways that the pseudorandom number generator can be used in ML. As you can see, the random seed can have an influence on the result of training in several ways and add a huge variance. One thing you do not need when tuning hyper-parameters is variance.


Knocking on Turing's door: Quantum Computing and Machine Learning

#artificialintelligence

We have all grown accustomed to seeing and using a contemporary computer. Each year, industry behemoths like Intel, AMD, ARM, and NVIDIA, release the next generation of their top-of-the-line silicon, locking horns, and pushing the envelope of the traditional computers that we know today. If we critically evaluate these multitudes of new multi-core CPUs, GPUs, and mammoth compute clusters hosted on the cloud, we will soon realize that faster processors do not necessarily result in increased computational power. Granted, the speed of computation has increased exponentially in the past decades, so has the amount of data we can handle and process. We can store and analyze exabytes of data on the internet, train deep learning models like OpenAI's GPT-3, and enable the computational intelligence needed to defeat champions and grandmasters at complex games like Go and Chess. But have all these technological advances expanded what we can fundamentally do with computers beyond where we started out with? Or simply put, have we changed our traditional model of computing? Modern computers operate according to the principle of a von Neumann architecture (Ogban et.al, 2007).


Machine Learning in a Day

#artificialintelligence

Learn "Machine Learning" in a Day.An eBook specially designed for novicesFundamentals of Machine Learning with real-life examples and exercises. Specially for professionals such as Doctors, Lawyers, Business Professionals, Artists and Content Creators.Chapter 1:Introduction:What is Artificial Intelligence (AI) ?What is Machine Learning (ML) ?Different types of Machine LearningChapter 2:Supervised Machine LearningReal-life examples of Supervised Machine LearningApplications of Supervised learning in medicine, law, finance and artChapter 3:Semi-Supervised Machine LearningHow to use Semi-Supervised Machine Learning?Applications of Semi-Supervised learning in medicine, law, finance and artChapter 4:Weakly-Supervised Machine LearningExamples of Weakly-Supervised Machine LearningApplications of Weakly-Supervised learning in medicine, law, finance and artChapter 5:Unsupervised Machine LearningDescription about Unsupervised Machine LearningPromising applications of Unsupervised learning in medicine, law, finance and artChapter 6:Self-supervised Machine LearningFuture of Self-supervised Machine LearningHow self-supervised learning can be used in law, finance, medicine and artChapter 7:Deep LearningHow Deep learning is changing the scope of Artificial IntelligenceApplications of Self-supervised learning in medicine, law, finance and artChapter 7:Future Directions10 futuristic applications of Machine LearningIf you are not satisfied, email us to get your money back. 100% Moneyback Guarantee!


Recurrent neural networks: The powerhouse of language modeling

#artificialintelligence

During the spring semester of my junior year in college, I had the opportunity to study abroad in Copenhagen, Denmark. I had never been to Europe before that, so I was incredibly excited to immerse myself into a new culture, meet new people, travel to new places, and, most important, encounter a new language. Now although English is not my native language (Vietnamese is), I have learned and spoken it since early childhood, making it second-nature. Danish, on the other hand, is an incredibly complicated language with a very different sentence and grammatical structure. Before my trip, I tried to learn a bit of Danish using the app Duolingo; however, I only got a hold of simple phrases such as Hello (Hej) and Good Morning (God Morgen).


Deep Learning vs. Machine Learning -- What's the Difference?

#artificialintelligence

Deep learning is a type of machine learning, which is a subset of artificial intelligence. Machine learning is about computers being able to think and act with less human intervention; deep learning is about computers learning to think using structures modeled on the human brain. Machine learning requires less computing power; deep learning typically needs less ongoing human intervention. Deep learning can analyze images, videos, and unstructured data in ways machine learning can't easily do. Every industry will have career paths that involve machine and deep learning.


Deep learning among top in demand skills of 2020 in India

#artificialintelligence

According to a report by silicon-valley-based Udacity, Karnataka holds the lion's share for maximum nanodegree programmes in 2020. As much as 24 per cent demand for deep learning and 34 per cent of the total demand for data engineering nanodegree programmes comes from Karnataka, the company said in a statement. The demand for AI product manager (38 per cent) and product manager (60 per cent) is also the highest in the state. Data science and deep learning are the most popular nanodegree programmes in Maharashtra. More than 40 per cent of the enrollments come from this state. New Delhi is a frontrunner in the mainstream programming languages.


Solving the mystery behind AI

#artificialintelligence

Artificial intelligence ( AI), deep learning, and neural networks represent powerful machine learning-based techniques used to solve many real-world problems. AI can be used in many different instances. AI is intelligence that has the ability to perceive information, retain it as knowledge and apply the knowledge within an environment. AI involves learning, understanding and application of the knowledge repetitively to achieve one or more goals. The human brain is exceptionally complex and is quite literally the most powerful computational machine known.


Large Batch Simulation for Deep Reinforcement Learning

arXiv.org Artificial Intelligence

We accelerate deep reinforcement learning-based training in visually complex 3D environments by two orders of magnitude over prior work, realizing end-to-end training speeds of over 19,000 frames of experience per second on a single GPU and up to 72,000 frames per second on a single eight-GPU machine. The key idea of our approach is to design a 3D renderer and embodied navigation simulator around the principle of "batch simulation": accepting and executing large batches of requests simultaneously. Beyond exposing large amounts of work at once, batch simulation allows implementations to amortize in-memory storage of scene assets, rendering work, data loading, and synchronization costs across many simulation requests, dramatically improving the number of simulated agents per GPU and overall simulation throughput. To balance DNN inference and training costs with faster simulation, we also build a computationally efficient policy DNN that maintains high task performance, and modify training algorithms to maintain sample efficiency when training with large mini-batches. By combining batch simulation and DNN performance optimizations, we demonstrate that PointGoal navigation agents can be trained in complex 3D environments on a single GPU in 1.5 days to 97% of the accuracy of agents trained on a prior state-of-the-art system using a 64-GPU cluster over three days. We provide open-source reference implementations of our batch 3D renderer and simulator to facilitate incorporation of these ideas into RL systems. It is now common for modern reinforcement learning (RL) algorithms leveraging deep neural networks (DNNs) to require billions of samples of experience from simulated environments (Wijmans et al., 2020; Petrenko et al., 2020; OpenAI et al., 2019; Silver et al., 2017; Vinyals et al., 2019). For embodied AI tasks such as visual navigation, where the ultimate goal for learned policies is deployment in the real world, learning from realistic simulations is important for successful transfer of learned policies to physical robots. In these cases simulators must render detailed 3D scenes and simulate agent interaction with complex environments (Kolve et al., 2017; Dosovitskiy et al., 2017; Savva et al., 2019; Xia et al., 2020; Gan et al., 2020). Evaluating and training a DNN on billions of simulated samples is computationally expensive.


Predicting the Behavior of Dealers in Over-The-Counter Corporate Bond Markets

arXiv.org Artificial Intelligence

Trading in Over-The-Counter (OTC) markets is facilitated by broker-dealers, in comparison to public exchanges, e.g., the New York Stock Exchange (NYSE). Dealers play an important role in stabilizing prices and providing liquidity in OTC markets. We apply machine learning methods to model and predict the trading behavior of OTC dealers for US corporate bonds. We create sequences of daily historical transaction reports for each dealer over a vocabulary of US corporate bonds. Using this history of dealer activity, we predict the future trading decisions of the dealer. We consider a range of neural network-based prediction models. We propose an extension, the Pointwise-Product ReZero (PPRZ) Transformer model, and demonstrate the improved performance of our model. We show that individual history provides the best predictive model for the most active dealers. For less active dealers, a collective model provides improved performance. Further, clustering dealers based on their similarity can improve performance. Finally, prediction accuracy varies based on the activity level of both the bond and the dealer.