Deep Learning
Andrii Gakhov's Blog - Books for Big Data and AI. How to start and where to go for software engineers. - March 14, 2019 09:27
After I have published a book that explains the algorithms of Big Data applications, I start getting questions and advice requests from people who want to extend their expertise to Big Data and AI problems. Since many software engineers thinking to shift to these hot domains, I found this topic very interesting and will try to explain my thought in an article so others could learn out of it as well. First of all, I would like to separate AI from Big Data. I have noticed that many people equate these two concepts. Let's figure it out their responsibilities.
Machine Learning, Deep Learning, and AI Terminology for the Layman
Here is one of the most viral videos about data science posted in the last few months, with over 500,000 views. I could not locate the original copy; I found it in a re-tweet by Kirk Borne. See link to the video below the picture. However, I was able to find who created it (Welcome.ai) To search these videos by keyword, click here.
DeepMind and Google: the battle to control artificial intelligence
One afternoon in August 2010, in a conference hall perched on the edge of San Francisco Bay, a 34-year-old Londoner called Demis Hassabis took to the stage. Walking to the podium with the deliberate gait of a man trying to control his nerves, he pursed his lips into a brief smile and began to speak: "So today I'm going to be talking about different approaches to buildingโฆ" He stalled, as though just realising that he was stating his momentous ambition out loud. And then he said it: "AGI". AGI stands for artificial general intelligence, a hypothetical computer program that can perform intellectual tasks as well as, or better than, a human. AGI will be able to complete discrete tasks, such as recognising photos or translating languages, which are the single-minded focus of the multitude of artificial intelligences (AIs) that inhabit our phones and computers. But it will also add, subtract, play chess and speak French. It will also understand physics papers, compose novels, devise investment strategies and make delightful conversation with strangers. It will monitor nuclear reactions, manage electricity grids and traffic flow, and effortlessly succeed at everything else. AGI will make today's most advanced AIs look like pocket calculators. The only intelligence that can currently attempt all these tasks is the kind that humans are endowed with. But human intelligence is limited by the size of the skull that houses the brain. Its power is restricted by the puny amount of energy that the body is able to provide. Because AGI will run on computers, it will suffer none of these constraints. Its intelligence will be limited only by the number of processors available.
FlexPod Datacenter for AI/ML with Cisco UCS C480 ML for Deep Learning Design Guide
NOTE: Works with document's Advanced Properties "First Published" property. NOTE: Works with document's Advanced Properties "Last Updated" property. The Cisco Validated Design (CVD) program consists of systems and solutions designed, tested, and documented to facilitate faster, more reliable, and more predictable customer deployments. ALL DESIGNS, SPECIFICATIONS, STATEMENTS, INFORMATION, AND RECOMMENDATIONS (COLLECTIVELY, "DESIGNS") IN THIS MANUAL ARE PRESENTED "AS IS," WITH ALL FAULTS. IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THE DESIGNS, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
How intelligent is artificial intelligence?
IMAGE: The heatmap shows quite clearly that the algorithm makes its ship/not ship decision on the basis of pixels representing water and not on the basis of pixels representing the ship.... view more Artificial Intelligence (AI) and machine learning algorithms such as Deep Learning have become integral parts of our daily lives: they enable digital speech assistants or translation services, improve medical diagnostics and are an indispensable part of future technologies such as autonomous driving. Based on an ever increasing amount of data and powerful novel computer architectures, learning algorithms appear to reach human capabilities, sometimes even excelling beyond. The issue: so far it often remains unknown to users, how exactly AI systems reach their conclusions. Therefore it may often remain unclear, whether the AI's decision making behavior is truly'intelligent' or whether the procedures are just averagely successful. Researchers from TU Berlin, Fraunhofer Heinrich Hertz Institute HHI and Singapore University of Technology and Design (SUTD) have tackled this question and have provided a glimpse into the diverse "intelligence" spectrum observed in current AI systems, specifically analyzing these AI systems with a novel technology that allows automatized analysis and quantification.
How to Find the Right Music for Your Video Using Deep Learning
Assume that you have a custom video and you want a soundtrack for some scenes in it. This method describes how to link together action, text, and music via digital fingerprinting technology. In this article, I'm going to present a possible method that can give you an answer on how to choose background music for videos. No matter what you do: a blog for your Youtube channel or amateur cinema for movie competition, or maybe you run a professional production studio, or you are a game developer and you need to find a soundtrack for your gameplay -- in any case, good music will increase the value of your video. This method describes how to pick music for a video using machine learning. This concept may be implemented using deep learning as a part of a broader family of machine learning methods.
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations
Dao, Tri, Gu, Albert, Eichhorn, Matthew, Rudra, Atri, Rรฉ, Christopher
Fast linear transforms are ubiquitous in machine learning, including the discrete Fourier transform, discrete cosine transform, and other structured transformations such as convolutions. All of these transforms can be represented by dense matrix-vector multiplication, yet each has a specialized and highly efficient (subquadratic) algorithm. We ask to what extent hand-crafting these algorithms and implementations is necessary, what structural priors they encode, and how much knowledge is required to automatically learn a fast algorithm for a provided structured transform. Motivated by a characterization of fast matrix-vector multiplication as products of sparse matrices, we introduce a parameterization of divide-and-conquer methods that is capable of representing a large class of transforms. This generic formulation can automatically learn an efficient algorithm for many important transforms; for example, it recovers the $O(N \log N)$ Cooley-Tukey FFT algorithm to machine precision, for dimensions $N$ up to $1024$. Furthermore, our method can be incorporated as a lightweight replacement of generic matrices in machine learning pipelines to learn efficient and compressible transformations. On a standard task of compressing a single hidden-layer network, our method exceeds the classification accuracy of unconstrained matrices on CIFAR-10 by 3.9 points---the first time a structured approach has done so---with 4X faster inference speed and 40X fewer parameters.
Unsupervised and interpretable scene discovery with Discrete-Attend-Infer-Repeat
Wang, Duo, Jamnik, Mateja, Lio, Pietro
In this work we present Discrete Attend Infer Repeat (Discrete-AIR), a Recurrent Auto-Encoder with structured latent distributions containing discrete categorical distributions, continuous attribute distributions, and factorised spatial attention. While inspired by the original AIR model andretaining AIR model's capability in identifying objects in an image, Discrete-AIR provides direct interpretability of the latent codes. We show that for Multi-MNIST and a multiple-objects version of dSprites dataset, the Discrete-AIR model needs just one categorical latent variable, one attribute variable (for Multi-MNIST only), together with spatial attention variables, for efficient inference. We perform analysis to show that the learnt categorical distributions effectively capture the categories of objects in the scene for Multi-MNIST and for Multi-Sprites.