Deep Learning
DeepMind's Mysterious Ethics Board Will Reportedly 'Control' AGI If It's Ever Created
DeepMind's ethics board has been a closely guarded secret ever since the artificial intelligence company was acquired by Google in 2014. But a new report from Hal Hodson at The Economist sheds some light on how the ethics board came about and what it's there for. DeepMind and Google signed an agreement drawn up by lawyers in London called the "Ethics and Safety Review Agreement" in the year leading up to the acquisition, according to the report. This agreement states that if DeepMind ever succeeds in its core mission of building artificial general intelligence (AGI)-- sometimes described as a machine that can successfully complete any intellectual task that a human can, and widely thought of as the holy grail in AI -- then the control of that machine will lie with those on a governing panel known as the Ethics Board, according to the report. The Ethics Board essentially allows DeepMind to legally maintain a degree of control over the technology it creates, no matter how valuable or dangerous it becomes, according to the report.
The 2019 Data Science Dictionary -- Key Terms You Need to Know
Activation function: In neural networks, linear and non-linear activation functions produce output decision boundaries by combining the network's weighted inputs. The ReLU (Rectified Linear Unit) activation function is the most commonly used activation function right now, although the Tanh or hyperbolic tangent, and Sigmoid or logistic activation functions are also used. Backpropagation: For this definition, I defer to a nice one I found by data scientist Mikio L. Braun on Quora: "Back prop is just gradient descent on individual errors. You compare the predictions of the neural network with the desired output and then compute the gradient of the errors with respect to the weights of the neural network. This gives you a direction in the parameter weight space in which the error would become smaller." Blockchain: Blockchain is essentially a decentralized distributed database.
MIT Introduction to Deep Learning
Talk Abstract: In spite of great success of deep learning a question remains to what extent the computational properties of deep neural networks (DNNs) are similar to those of the human brain. The particularly non-biological aspect of deep learning is the supervised training process with the backpropagation algorithm, which requires massive amounts of labeled data, and a non-local learning rule for changing the synapse strengths. In this talk I will describes a learning algorithm that does not suffer from these two problems. It learns the weights of the lower layer of neural networks in a completely unsupervised fashion. The entire algorithm utilizes local learning rules which have conceptual biological plausibility.
My favorite mind-blowing Machine Learning/AI breakthroughs
Compared to other fields, machine learning / artificial intelligence seems to have a much higher frequency of super-interesting developments these days. Things that make you say "wow" or even "what a time to be alive!" Disclaimer: I'm not using any rigorous definition of "mind-blowing" or "breakthrough"; it's a casual list.. and I might use less rigorous terminology to make this post more accessible We can accurately estimate how a human on the other side of a wall is standing/sitting/walking just from perturbations in Wifi signals caused by that human. The researchers first demonstrated in 2014 that they can e.g. This part was done without machine learning.
Deep Learning versus Biological Neurons: floating-point numbers, spikes, and neurotransmitters
In recent years, "deep learning" AI models have often been touted as "working like the brain," in that they are composed of artificial neurons mimicking those of biological brains. From the perspective of a neuroscientist, however, the differences between deep learning neurons and biological neurons are numerous and distinct. In this post we'll start by describing a few key characteristics of biological neurons, and how they are simplified to obtain deep learning neurons. We'll then speculate on how these differences impose limits on deep learning networks, and how movement toward more realistic models of biological neurons might advance AI as we currently know it. Typical biological neurons are individual cells, each composed of the main body of the cell along with many tendrils that extend from that body. The body, or soma, houses the machinery for maintaining basic cell functions and energy processing (e.g., the DNA-containing nucleus, and organelles for building proteins and processing sugar and oxygen).
IBM, Intel Papers Report AI Breakthroughs for Quantum Science
Fascinatingly, two announcements today show how AI (machine and deep learning) can influence quantum computing in quite different ways. The twin announcements closely track prestigious publications. The MIT, Oxford, and IBM-led paper, Supervised learning with quantum-enhanced feature spaces, was published in Nature today. The Intel-led paper, Quantum Entanglement in Deep Learning Architectures, was published in APS Physical Review Letters last month. Intel made its announcement in conjunction with Intel Mobileye co-founder/CEO Amnon Shashua's keynote today at the National Academy of Sciences'Science of Deep Learning' conference.
IBM, Intel Papers Report AI Breakthroughs for Quantum Science
Fascinatingly, two announcements today show how AI (machine and deep learning) can influence quantum computing in quite different ways. The twin announcements closely track prestigious publications. The MIT, Oxford, and IBM-led paper, Supervised learning with quantum-enhanced feature spaces, was published in Nature today. The Intel-led paper, Quantum Entanglement in Deep Learning Architectures, was published in APS Physical Review Letters last month. Intel made its announcement in conjunction with Intel Mobileye co-founder/CEO Amnon Shashua's keynote today at the National Academy of Sciences'Science of Deep Learning' conference.
Google offers new offline voice recognition feature AndroidPIT
In 2012, research in the field of speech recognition showed important advances produced by automatic learning, more precisely with the use of deep neural networks for acoustic modeling. These developments enabled the adoption of this function in products such as Google's search engine, also known as Google Voice Search. But that was only the beginning of a whole revolution; new architectures began to appear every year, to improve recognition technology: from deep (DNN) and recurrent (RNN) neural networks to convolutional neural networks, to name a few examples. One of the most important objectives of these architectures has always been to reduce latency. In other words, shorten the waiting time between speech and recognition. With that goal in mind, Google has announced the introduction of a new neural recognition feature to make it easier to enter text on its Gboard keyboard.
DSC Webinar Series: Applying Convolutional Neural Networks with TensorFlow
In this latest Data Science Central Deep Learning Fundamentals Series webinar, we will cover the fundamentals behind TensorFlow and how to apply them within a convolutional neural network (CNN) example. The principles we will cover include CNN concepts and their impact to the accuracy and loss of your network. All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly access ready-to-use ML environments, as well as prepare data, and train models faster. After this session, if requested, you will receive the presentation and associated notebooks so you can run the samples yourself.
How Intelligent is Artificial Intelligence?
Artificial Intelligence (AI) and machine learning algorithms such as Deep Learning have become integral parts of our daily lives: they enable digital speech assistants or translation services, improve medical diagnostics and are an indispensable part of future technologies such as autonomous driving. Based on an ever increasing amount of data and powerful novel computer architectures, learning algorithms appear to reach human capabilities, sometimes even excelling beyond. The issue: so far it often remains unknown to users, how exactly AI systems reach their conclusions. Therefore it may often remain unclear, whether the AI's decision making behavior is truly'intelligent' or whether the procedures are just averagely successful. Researchers from TU Berlin, Fraunhofer Heinrich Hertz Institute HHI and Singapore University of Technology and Design (SUTD) have tackled this question and have provided a glimpse into the diverse "intelligence" spectrum observed in current AI systems, specifically analyzing these AI systems with a novel technology that allows automatized analysis and quantification.