Goto

Collaborating Authors

 Education


Start Your Machine Learning Career in Quarantine - KDnuggets

#artificialintelligence

In this article, I outline a full curriculum for machine learning, considering this quarantine will stick around for at least 2 months. It is the most used language in Machine Learning/Data Science. You can learn the basics of it easily in 3 days. Follow along with this Youtube series by Sentdex. You will learn all the functional programming in Python.


The Deep Bootstrap: Good Online Learners are Good Offline Generalizers

arXiv.org Machine Learning

We propose a new framework for reasoning about generalization in deep learning. The core idea is to couple the Real World, where optimizers take stochastic gradient steps on the empirical loss, to an Ideal World, where optimizers take steps on the population loss. This leads to an alternate decomposition of test error into: (1) the Ideal World test error plus (2) the gap between the two worlds. If the gap (2) is universally small, this reduces the problem of generalization in offline learning to the problem of optimization in online learning. We then give empirical evidence that this gap between worlds can be small in realistic deep learning settings, in particular supervised image classification. For example, CNNs generalize better than MLPs on image distributions in the Real World, but this is "because" they optimize faster on the population loss in the Ideal World. This suggests our framework is a useful tool for understanding generalization in deep learning, and lays a foundation for future research in the area.


Decision Making Problems with Funnel Structure: A Multi-Task Learning Approach with Application to Email Marketing Campaigns

arXiv.org Machine Learning

This paper studies the decision making problem with Funnel Structure. Funnel structure, a well-known concept in the marketing field, occurs in those systems where the decision maker interacts with the environment in a layered manner receiving far fewer observations from deep layers than shallow ones. For example, in the email marketing campaign application, the layers correspond to Open, Click and Purchase events. Conversions from Click to Purchase happen very infrequently because a purchase cannot be made unless the link in an email is clicked on. We formulate this challenging decision making problem as a contextual bandit with funnel structure and develop a multi-task learning algorithm that mitigates the lack of sufficient observations from deeper layers. We analyze both the prediction error and the regret of our algorithms. We verify our theory on prediction errors through a simple simulation. Experiments on both a simulated environment and an environment based on real-world data from a major email marketing company show that our algorithms offer significant improvement over previous methods.


Meta-learning for Multi-variable Non-convex Optimization Problems: Iterating Non-optimums Makes Optimum Possible

arXiv.org Machine Learning

In this paper, we aim to address the problem of solving a non-convex optimization problem over an intersection of multiple variable sets. This kind of problems is typically solved by using an alternating minimization (AM) strategy which splits the overall problem into a set of sub-problems corresponding to each variable, and then iteratively performs minimization over each sub-problem using a fixed updating rule. However, due to the intrinsic non-convexity of the overall problem, the optimization can usually be trapped into bad local minimum even when each sub-problem can be globally optimized at each iteration. To tackle this problem, we propose a meta-learning based Global Scope Optimization (GSO) method. It adaptively generates optimizers for sub-problems via meta-learners and constantly updates these meta-learners with respect to the global loss information of the overall problem. Therefore, the sub-problems are optimized with the objective of minimizing the global loss specifically. We evaluate the proposed model on a number of simulations, including solving bi-linear inverse problems: matrix completion, and non-linear problems: Gaussian mixture models. The experimental results show that our proposed approach outperforms AM-based methods in standard settings, and is able to achieve effective optimization in some challenging cases while other methods would typically fail.


What is More Likely to Happen Next? Video-and-Language Future Event Prediction

arXiv.org Artificial Intelligence

Given a video with aligned dialogue, people can often infer what is more likely to happen next. Making such predictions requires not only a deep understanding of the rich dynamics underlying the video and dialogue, but also a significant amount of commonsense knowledge. In this work, we explore whether AI models are able to learn to make such multimodal commonsense next-event predictions. To support research in this direction, we collect a new dataset, named Video-and-Language Event Prediction (VLEP), with 28,726 future event prediction examples (along with their rationales) from 10,234 diverse TV Show and YouTube Lifestyle Vlog video clips. In order to promote the collection of non-trivial challenging examples, we employ an adversarial human-and-model-in-the-loop data collection procedure. We also present a strong baseline incorporating information from video, dialogue, and commonsense knowledge. Experiments show that each type of information is useful for this challenging task, and that compared to the high human performance on VLEP, our model provides a good starting point but leaves large room for future work. Our dataset and code are available at: https://github.com/jayleicn/VideoLanguageFuturePred


Interpretation of Swedish Sign Language using Convolutional Neural Networks and Transfer Learning

arXiv.org Artificial Intelligence

The automatic interpretation of sign languages is a challenging task, as it requires the usage of high-level vision and high-level motion processing systems for providing accurate image perception. In this paper, we use Convolutional Neural Networks (CNNs) and transfer learning in order to make computers able to interpret signs of the Swedish Sign Language (SSL) hand alphabet. Our model consist of the implementation of a pre-trained InceptionV3 network, and the usage of the mini-batch gradient descent optimization algorithm. We rely on transfer learning during the pre-training of the model and its data. The final accuracy of the model, based on 8 study subjects and 9,400 images, is 85%. Our results indicate that the usage of CNNs is a promising approach to interpret sign languages, and transfer learning can be used to achieve high testing accuracy despite using a small training dataset. Furthermore, we describe the implementation details of our model to interpret signs as a user-friendly web application.


Machine Learning Regression Masterclass in Python

#artificialintelligence

Free Coupon Discount - Machine Learning Regression Masterclass in Python, Build 8 Practical Projects and Master Machine Learning Regression Techniques Using Python, Scikit Learn and Keras Created by Dr. Ryan Ahmed, Ph.D., MBA, Kirill Eremenko, Hadelin de Ponteves, SuperDataScience Team, Mitchell Bouchard Students also bought Unsupervised Deep Learning in Python Deep Learning Prerequisites: Linear Regression in Python Neural Networks in Python from Scratch: Complete guide Artificial Intelligence: Optimization Algorithms in Python Machine Learning Practical: 6 Real-World Applications Preview this Udemy Course GET COUPON CODE Description Artificial Intelligence (AI) revolution is here! The technology is progressing at a massive scale and is being widely adopted in the Healthcare, defense, banking, gaming, transportation and robotics industries. Machine Learning is a subfield of Artificial Intelligence that enables machines to improve at a given task with experience. Machine Learning is an extremely hot topic; the demand for experienced machine learning engineers and data scientists has been steadily growing in the past 5 years. According to a report released by Research and Markets, the global AI and machine learning technology sectors are expected to grow from $1.4B to $8.8B by 2022 and it is predicted that AI tech sector will create around 2.3 million jobs by 2020.


Free From MIT: Intro to Computational Thinking and Data Science - KDnuggets

#artificialintelligence

It aims to provide students with an understanding of the role computation can play in solving problems and to help students, regardless of their major, feel justifiably confident of their ability to write small programs that allow them to accomplish useful goals. The class uses the Python 3.5 programming language. The Fall 2016 iteration of this course is taught by Eric Grimson, John Guttag, and Ana Bell. The course is taught using only Python as the implementation programming language.


How AI is improving the education sector

#artificialintelligence

We're in 2020 and long past the days back when we used to stand outside the school library to get the opportunity to copy two or three Encyclopedia pages, to use as a kind of reference for our school projects. With this age having grown up with the benefit of access to technology at their fingertips, the field of education has hugely changed and overturned in this digitally driven world. Artificial Intelligence in the education market was worth US$2.022 billion for the year 2019. The worldwide AI in the education market is anticipated to be valued at USD 3.68 billion by 2023, at a CAGR of 47% during the forecast period of 2018 till 2023. Artificial intelligence has already infiltrated our lives on an individual level.


How to have the "automation talk" with your employees

#artificialintelligence

"Automation" is a loaded word. Not for what it is--artificial intelligence handling the busywork, so humans can tackle larger problems--but for what it implies: Threats of job elimination, dehumanized processes, and that those at the heart of this change, the employees, won't have a say in any of it. Technology will continue to upend the way we work. Understandably, that uncertainty can be daunting. Not knowing what's going to happen is exciting when you're watching a prestige television drama, not when your employment is concerned.