Goto

Collaborating Authors

 Deep Learning


Future of AI Part 2

#artificialintelligence

This part of the series looks at the future of AI with much of the focus in the period after 2025. The leading AI researcher, Geoff Hinton, stated that it is very hard to predict what advances AI will bring beyond five years, noting that exponential progress makes the uncertainty too great. This article will therefore consider both the opportunities as well as the challenges that we will face along the way across different sectors of the economy. It is not intended to be exhaustive. AI deals with the area of developing computing systems which are capable of performing tasks that humans are very good at, for example recognising objects, recognising and making sense of speech, and decision making in a constrained environment. Some of the classical approaches to AI include (non-exhaustive list) Search algorithms such as Breath-First, Depth-First, Iterative Deepening Search, A* algorithm, and the field of Logic including Predicate Calculus and Propositional Calculus. Local Search approaches were also developed for example Simulated Annealing, Hill Climbing (see also Greedy), Beam Search and Genetic Algorithms (see below). Machine Learning is defined as the field of AI that applies statistical methods to enable computer systems to learn from the data towards an end goal. The term was introduced by Arthur Samuel in 1959. A non-exhaustive list of examples of techniques include Linear Regression, Logistic Regression, K-Means, k-Nearest Neighbour (kNN), Naive Bayes, Support Vector Machine (SVM), Decision Trees, Random Forests, XG Boost, Light Gradient Boosting Machine (LightGBM), CatBoost. Deep Learning refers to the field of Neural Networks with several hidden layers. Such a neural network is often referred to as a deep neural network. Neural Networks are biologically inspired networks that extract abstract features from the data in a hierarchical fashion.


Deep Learning in Clojure with Fewer Parentheses than Keras and Python

#artificialintelligence

New books are available for subscription. Deep Diamond() is a new Deep Learning library written in Clojure. Its goal is to be simple, superfast, and to support both CPU and GPU computing. But it's Clojure, you might say. Python is supported by Google and Facebook.


Implementing a Deep Learning Library from Scratch in Python - KDnuggets

#artificialintelligence

Deep Learning has evolved from simple neural networks to quite complex architectures in a short span of time. To support this rapid expansion, many different deep learning platforms and libraries are developed along the way. One of the primary goals for these libraries is to provide easy to use interfaces for building and training deep learning models, that would allow users to focus more on the tasks at hand. To achieve this, it may require to hide core implementation units behind several abstraction layers that make it difficult to understand basic underlying principles on which deep learning libraries are based. Hence the goal of this article is to provide insights on building blocks of deep learning library.


Malicious Network Traffic Detection via Deep Learning: An Information Theoretic View

#artificialintelligence

The attention that deep learning has garnered from the academic community and industry continues to grow year over year, and it has been said that we are in a new golden age of artificial intelligence research. However, neural networks are still often seen as a "black box" where learning occurs but cannot be understood in a human-interpretable way. Since these machine learning systems are increasingly being adopted in security contexts, it is important to explore these interpretations. We consider an Android malware traffic dataset for approaching this problem. Then, using the information plane, we explore how homeomorphism affects learned representation of the data and the invariance of the mutual information captured by the parameters on that data.


Why Deep Learning DevCon Comes At The Right Time

#artificialintelligence

The Association of Data Scientists (ADaSci) recently announced Deep Learning DEVCON or DLDC 2020, a two-day virtual conference that aims to bring machine learning and deep learning practitioners and experts from the industry on a single platform to share and discuss recent developments in the field. Scheduled for 29th and 30th October, the conference comes at a time when deep learning, a subset of machine learning, has become one of the most advancing technologies in the world. From being used in the fields of natural language processing to making self-driving cars, it has come a long way. As a matter of fact, reports suggest that by 2024, the deep learning market is expected to grow at a CAGR of 25%. Thus, it can easily be established that the advancements in the field of deep learning have just initiated and got a long road ahead.


Quick thoughts on GPT3

#artificialintelligence

OpenAI, an AI research foundation started by Elon Musk, Sam Altman, Greg Brockman, and a few other leaders in ML, recently released an API and website that allows people to access a new language model called GPT-3. I've had the chance to play with it over the past few days and have been truly amazed by its capabilities. I'd like to start this off by stating that, especially amongst my extremely intelligent ML friends, I am quite the layman, so this post is more aimed for a nontechnical audience and I apologize if I make any technical errors in this post. GPT-3 is essentially a context-based generative AI. What this means is that when the AI is given some sort of context, it then tries to fill in the rest.


Generating TV Scripts with LSTM

#artificialintelligence

Hello friends, I just completed this project as a part of the Deep Learning Nanodegree at Udacity. The project is about predicting the next word in the script, given the previous context using LSTM. I'll be explaining the major and the very basic concepts that will be required while doing the project. The sections which I've covered include: How our data can be transformed into a form that the model can work with? How the model architecture works with the batched data, passing it from one layer to the other and how it finally leads to predicting the next word in the sequence. This is a fundamental project done with LSTM, anyone having basic knowledge about neural networks and RNNs can easily understand this.


Why neural networks struggle with the Game of Life

#artificialintelligence

This article is part of our reviews of AI research papers, a series of posts that explore the latest findings in artificial intelligence. The Game of Life is a grid-based automaton that is very popular in discussions about science, computation, and artificial intelligence. It is an interesting idea that shows how very simple rules can yield very complicated results. Despite its simplicity, however, the Game of Life remains a challenge to artificial neural networks, AI researchers at Swarthmore College and the Los Alamos National Laboratory have shown in a recent paper. Titled, "It's Hard for Neural Networks To Learn the Game of Life," their research investigates how neural networks explore the Game of Life and why they often miss finding the right solution. Their findings highlight some of the key issues with deep learning models and give some interesting hints at what could be the next direction of research for the AI community.


GPT-3 vs. AGI

#artificialintelligence

So what will it take to get to AGI? How will we give computers an understanding of time and space? We humans are great at merging information from multiple senses. A child will use all its senses to learn about blocks. The child learns about time by experiencing it, by interacting with toys and the world. In the same way, AGI will need a robotic body to learn similar things, at least at the outset.


Artificial Intelligence (GPT-3) Explains How RAM (Computer Memory) Works

#artificialintelligence

Kirk Ouimet: Grateful to have the opportunity to speak with you today. Wise Being: Grateful to be able to help you. Kirk Ouimet: I wanted to talk about computers today if that is OK with you. Kirk Ouimet: So I have built computers all of my life. My Dad and I built them together when I was a kid.