Goto

Collaborating Authors

 Education


Generating Training Datasets Using Energy Based Models that Actually Scale

#artificialintelligence

Energy-Based Models(EBM) is one of the most promising areas of deep learning that hasn't seen a tremendous level of adoption yet. Conceptually, EBMs are a form of generative modeling that learns the key characteristics of a target dataset and tries to generate similar datasets. While EBMs results appealing because of its simplicity they have experienced many challenges when applied in real world applications. Recently, AI-powerhouse OpenAI published a new research paper that explores a new technique to create EBM model that can scale across complex deep learning topologies. EBMs are typically used in one of the most complex problems of real world deep learning solutions: generating quality training datasets.



AI Training and Training with AI - Constructech

#artificialintelligence

What this will mean, in the short term, is that AI will become significantly more capable, in less time due to dramatically faster prototyping and larger scale training. In addition, there will be a growth in practical applications of AI because the new paradigm of training at the edge avoids the huge upfront costs of centralized training in the cloud. Millions more developers can now participate in advancing AI solutions. Because training can be coordinated between devices using the IoT (Internet of Things), the cloud infrastructure will have a diminished role. One of the early applications of AI in the construction industry is for training workers and improving their skills.


Spark Machine Learning Project (House Sale Price Prediction)

#artificialintelligence

Get your team access to 3,500 top Udemy courses anytime, anywhere. In this Data science Machine Learning project, we will predict the sales prices in the Housing data set using LinearRegression one of the predictive models. Databricks lets you start writing Spark ML code instantly so you can focus on your data problems.


Employee Attrition Prediction in Apache Spark (ML)

#artificialintelligence

Get your team access to 3,500 top Udemy courses anytime, anywhere. In this Data science Machine Learning project, we will create Employee Attrition Prediction Project using Decision Tree Classification algorithm one of the predictive models. Databricks lets you start writing Spark ML code instantly so you can focus on your data problems.


Telecom Customer Churn Prediction in Apache Spark (ML)

#artificialintelligence

In this Data science Machine Learning project, we will create Telecom Customer Churn Prediction Project using Classification Model Logistic Regression, Naive Bayes and One-vs-Rest classifier few of the predictive models. Databricks lets you start writing Spark ML code instantly so you can focus on your data problems.


Call you tell a real face from an AI-generated one?

#artificialintelligence

There's fake news, fake Nigerian princes, fake weather, even deep fakes of celebrities โ€ฆ but if you see a picture of someone on the internet, whether it's been used legitimately or is identity theft, it must be of a real person, right? Neural networks have become so sophisticated that they can generate convincing images of people who don't exist. Using what is known as a generative adversarial network (GAN) approach, two neural networks essentially play a game of cat and mouse: one learns from a database of real face and creates an artificial image, the other network helps it improve by guessing if the face is real or not. This technology, claim Jevin West and Carl Bergstrom at the University of Washington, is now being used in espionage to create false identities. They have created a game called Which Face Is Real, in order to show people how good these neural networks are at generating fictional human faces.


Multi-fidelity Gaussian Process Bandit Optimisation

Journal of Artificial Intelligence Research

In many scientific and engineering applications, we are tasked with the maximisation of an expensive to evaluate black box function f. Traditional settings for this problem assume just the availability of this single function. However, in many cases, cheap approximations to f may be obtainable. For example, the expensive real world behaviour of a robot can be approximated by a cheap computer simulation. We can use these approximations to eliminate low function value regions cheaply and use the expensive evaluations of f in a small but promising region and speedily identify the optimum. We formalise this task as a multi-fidelity bandit problem where the target function and its approximations are sampled from a Gaussian process. We develop MF-GP-UCB, a novel method based on upper confidence bound techniques. In our theoretical analysis we demonstrate that it exhibits precisely the above behaviour and achieves better bounds on the regret than strategies which ignore multi-fidelity information. Empirically, MF-GP-UCB outperforms such naive strategies and other multi-fidelity methods on several synthetic and real experiments.


Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Model

arXiv.org Machine Learning

Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading comprehension tasks with a language representation model pre-trained on multi-lingual corpus. The experimental results show that with pre-trained language representation zero-shot learning is feasible, and translating the source data into the target language is not necessary and even degrades the performance. We further explore what does the model learn in zero-shot setting.


Model Based Planning with Energy Based Models

arXiv.org Machine Learning

Model-based planning holds great promise for improving both sample efficiency and generalization in reinforcement learning (RL). We show that energy-based models (EBMs) are a promising class of models to use for model-based planning. EBMs naturally support inference of intermediate states given start and goal state distributions. We provide an online algorithm to train EBMs while interacting with the environment, and show that EBMs allow for significantly better online learning than corresponding feed-forward networks. We further show that EBMs support maximum entropy state inference and are able to generate diverse state space plans. We show that inference purely in state space - without planning actions - allows for better generalization to previously unseen obstacles in the environment and prevents the planner from exploiting the dynamics model by applying uncharacteristic action sequences. Finally, we show that online EBM training naturally leads to intentionally planned state exploration which performs significantly better than random exploration.