Education
Teach yourself about machine learning and artificial intelligence - Marketing Land
Though you'll hear near universal praise for data-driven decision-making, many companies haven't yet been able to put such a strategy into practice. Well, one barrier, acknowledged by 75 percent of marketers surveyed by Econsultancy last year, is that too few in the marketing realm have the requisite training and education on data and analytics, particularly in the areas of artificial intelligence (AI) and machine learning. This situation leads both to hiring challenges and to great opportunities for those who possess or can develop the necessary skill set. If your company or agency doesn't already have training programs in place, you'd do well to take matters into your own hands, as there are myriad online offerings that allow you to school yourself on the latest technologies. And they're not all oriented toward programmers, meaning they can help marketers understand the best use cases and necessary building blocks for employing machine learning and AI to best advantage.
8 Data Science Projects to Build your Portfolio Data Science Blog
A decade ago, machine learning was simply a concept but today it has changed the way we interact with technology. Devices are becoming smarter, faster and better, with Machine Learning at the helm. Thus, we have designed a comprehensive list of projects in Machine Learning course that offers a hands-on experience with ML and how to build actual projects using the Machine Learning algorithms. Furthermore, this course is a follow up to our Introduction to Machine Learning course and delves further deeper into the practical applications of Machine Learning. In this blog, we will have a look at projects divided mostly into two different levels i.e.
Who will decide which students get into college โ a committee or a computer?
In this March 7, 2017 file photo, rowers paddle along the Charles River past the Harvard College campus in Cambridge, Mass. It's crunch time for college applications, and hopeful high school seniors are working hard to impress admissions committees to land a spot at the school of their choice. What if, instead, you had to impress a robot โ or win over an artificial intelligence-driven algorithm? You did everything you could to package your application to highlight just the right combination of grades, extracurriculars and eye-catching essays the counselor at your high school said the admissions committees at your target schools were looking for. Was it all a big waste of time?
An Introduction to Deep Reinforcement Learning
Francois-Lavet, Vincent, Henderson, Peter, Islam, Riashat, Bellemare, Marc G., Pineau, Joelle
Deep reinforcement learning is the combination of reinforcement learning (RL) and deep learning. This field of research has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine. Thus, deep RL opens up many new applications in domains such as healthcare, robotics, smart grids, finance, and many more. This manuscript provides an introduction to deep reinforcement learning models, algorithms and techniques. Particular focus is on the aspects related to generalization and how deep RL can be used for practical applications. We assume the reader is familiar with basic machine learning concepts.
Towards Solving Text-based Games by Producing Adaptive Action Spaces
Tao, Ruo Yu, Cรดtรฉ, Marc-Alexandre, Yuan, Xingdi, Asri, Layla El
To solve a text-based game, an agent needs to formulate valid text commands for a given context and find the ones that lead to success. Recent attempts at solving text-based games with deep reinforcement learning have focused on the latter, i.e., learning to act optimally when valid actions are known in advance. In this work, we propose to tackle the first task and train a model that generates the set of all valid commands for a given context. We try three generative models on a dataset generated with Textworld. The best model can generate valid commands which were unseen at training and achieve high $F_1$ score on the test set.
How Do Classifiers Induce Agents To Invest Effort Strategically?
Kleinberg, Jon, Raghavan, Manish
One of the fundamental insights in the economics of information is the way in which assessing people (students, job applicants, employees) can serve two purposes simultaneously: it can identify the strongest performers, and it can also motivate people to invest effort in improving their performance [29]. This principle has only grown in importance with the rise in algorithmic methods for predicting individual performance across a wide range of domains, including education, employment, and finance. Akey challenge is that we do not generally have access to the true underlying properties that we need for an assessment; rather, they are encoded by an intermediate layer of features, so that the true properties determine the features, and the features then determine our assessment. Standardized testing in education is a canonical example, in which a test score serves as a proxy feature for a student's level of learning, mastery of material, and perhaps other properties we are seeking to evaluate as well. In this case, as in many others, the quantity we wish to measure is unobservable, or at the very least, difficult to accurately measure; the observed feature is a construct interposed between the decision rule and the intended quantity. This role that features play, as a kind of necessary interface between the underlying attributes and the decisions that depend on them, leads to a number of challenges. In particular, when an individual invests effort to perform better on a measure designed by an evaluator, there is a basic tension between effort invested to raise the true underlying attributes that the evaluator cares about, and effort that may serve to improve the proxy features without actually improving the underlying attributes. This tension appears in many contexts -- it is the problem of gaming the evaluation rule, and it underlies the formulation of Goodhart's Law, widely known in the economics literature, which states that once a proxy measure becomes a goal in itself, it is no longer a useful measure [17].
Transferring Knowledge across Learning Processes
Flennerhag, Sebastian, Moreno, Pablo G., Lawrence, Neil D., Damianou, Andreas
In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer learning at a higher level of abstraction is needed. We propose Leap, a framework that achieves this by transferring knowledge across learning processes. We associate each task with a manifold on which the training process travels from initialization to final parameters and construct a meta learning objective that minimizes the expected length of this path. Our framework leverages only information obtained during training and can be computed on the fly at negligible cost. We demonstrate that our framework outperforms competing methods, both in meta learning and transfer learning, on a set of computer vision tasks. Finally, we demonstrate that Leap can transfer knowledge across learning processes in demanding Reinforcement learning environments (Atari) that involve millions of gradient steps.
Accelerating Large Scale Knowledge Distillation via Dynamic Importance Sampling
Li, Minghan, Zuo, Tanli, Li, Ruicheng, White, Martha, Zheng, Weishi
Knowledge distillation is an effective technique that transfers knowledge from a large teacher model to a shallow student. However, just like massive classification, large scale knowledge distillation also imposes heavy computational costs on training models of deep neural networks, as the softmax activations at the last layer involve computing probabilities over numerous classes. In this work, we apply the idea of importance sampling which is often used in Neural Machine Translation on large scale knowledge distillation. W e present a method called dynamic importance sampling, where ranked classes are sampled from a dynamic distribution derived from the interaction between the teacher and student in full distillation. W e highlight the utility of our proposal prior which helps the student capture the main information in the loss function. Our approach manages to reduce the computational cost at training time while maintaining the competitive performance on CIF AR-100 and Market-1501 person re-identification datasets.
Early Prediction of Course Grades: Models and Feature Selection
Li, Hengxuan, Lynch, Collin F., Barnes, Tiffany
In this paper, we compare predictive models for students' final performance in a blended course using a set of generic features collected from the first six weeks of class. These features were extracted from students' online homework submission logs as well as other online actions. We compare the effectiveness of 5 different ML algorithms (SVMs, Support Vector Regression, Decision Tree, Naive Bayes and K-Nearest Neighbor). We found that SVMs outperform other models and improve when compared to the baseline. This study demonstrates feasible implementations for predictive models that rely on common data from blended courses that can be used to monitor students' progress and to tailor instruction.
Knowledge Distillation with Feature Maps for Image Classification
Chen, Wei-Chun, Chang, Chia-Che, Lu, Chien-Yu, Lee, Che-Rung
The model reduction problem that eases the computation costs and latency of complex deep learning architectures has received an increasing number of investigations owing to its importance in model deployment. One promising method is knowledge distillation (KD), which creates a fast-to-execute student model to mimic a large teacher network. In this paper, we propose a method, called KDFM (Knowledge Distillation with Feature Maps), which improves the effectiveness of KD by learning the feature maps from the teacher network. Two major techniques used in KDFM are shared classifier and generative adversarial network. Experimental results show that KDFM can use a four layers CNN to mimic DenseNet-40 and use MobileNet to mimic DenseNet-100. Both student networks have less than 1\% accuracy loss comparing to their teacher models for CIFAR-100 datasets. The student networks are 2-6 times faster than their teacher models for inference, and the model size of MobileNet is less than half of DenseNet-100's.