Goto

Collaborating Authors

 Education


How to get up to speed on Machine Learning and AI

#artificialintelligence

For more depth, we recommend this insightful review article by UW Prof. Pedro Domingos: A Few Useful Things to Know about Machine Learning


New Poll: Data Science Skills

#artificialintelligence

New(*) KDnuggets poll is asking: Which skills / knowledge areas do you currently have (at the level you can use in work or research)? Poll Which skills / knowledge areas do you currently have, at the level you can use in work or research? Industry/Self-employed Government/non-profit Academia/University Student Other or unemployed Current Results (*) Note: we previously launched this poll using another method, and it was attacked by overzealous fans of Julia and MATLAB which generated 50,000 votes for each. As a result, we had to remove Julia and MATLAB from this relaunched poll, but kept other votes. So, if you voted already in this poll, and you are not a bot, your vote is counted.


A Survey of Automated Programming Hint Generation -- The HINTS Framework

arXiv.org Artificial Intelligence

Automated tutoring systems offer the flexibility and scalability necessary to facilitate the provision of high quality and universally accessible programming education. In order to realise the full potential of these systems, recent work has proposed a diverse range of techniques for automatically generating hints to assist students with programming exercises. This paper integrates these apparently disparate approaches into a coherent whole. Specifically, it emphasises that all hint techniques can be understood as a series of simpler components with similar properties. Using this insight, it presents a simple framework for describing such techniques, the Hint Iteration by Narrow-down and Transformation Steps (HINTS) framework, and it surveys recent work in the context of this framework. It discusses important implications of the survey and framework, including the need to further develop evaluation methods and the importance of considering hint technique components when designing, communicating and evaluating hint systems. Ultimately, this paper is designed to facilitate future opportunities for the development, extension and comparison of automated programming hint techniques in order to maximise their educational potential.


Meta-Learning with Warped Gradient Descent

arXiv.org Machine Learning

A versatile and effective approach to meta-learning is to infer a gradient-based up-date rule directly from data that promotes rapid learning of new tasks from the same distribution. Current methods rely on backpropagating through the learning process, limiting their scope to few-shot learning. In this work, we introduce Warped Gradient Descent (WarpGrad), a family of modular optimisers that can scale to arbitrary adaptation processes. WarpGrad methods meta-learn to warp task loss surfaces across the joint task-parameter distribution to facilitate gradient descent, which is achieved by a reparametrisation of neural networks that interleaves warp layers in the architecture. These layers are shared across task learners and fixed during adaptation; they represent a projection of task parameters into a meta-learned space that is conducive to task adaptation and standard backpropagation induces a form of gradient preconditioning. WarpGrad methods are computationally efficient and easy to implement as they rely on parameter sharing and backpropagation. They are readily combined with other meta-learners and can scale both in terms of model size and length of adaptation trajectories as meta-learning warp parameters do not require differentiation through task adaptation processes. We show empirically that WarpGrad optimisers meta-learn a warped space where gradient descent is well behaved, with faster convergence and better performance in a variety of settings, including few-shot, standard supervised, continual, and reinforcement learning.


Partitioned integrators for thermodynamic parameterization of neural networks

arXiv.org Machine Learning

Stochastic Gradient Langevin Dynamics, the "unadjusted Langevin algorithm", and Adaptive Langevin Dynamics (also known as Stochastic Gradient Nos\'{e}-Hoover dynamics) are examples of existing thermodynamic parameterization methods in use for machine learning, but these can be substantially improved. We find that by partitioning the parameters based on natural layer structure we obtain schemes with rapid convergence for data sets with complicated loss landscapes. We describe easy-to-implement hybrid partitioned numerical algorithms, based on discretized stochastic differential equations, which are adapted to feed-forward neural networks, including LaLa (a multi-layer Langevin algorithm), AdLaLa (combining the adaptive Langevin and Langevin algorithms) and LOL (combining Langevin and Overdamped Langevin); we examine the convergence of these methods using numerical studies and compare their performance among themselves and in relation to standard alternatives such as stochastic gradient descent and ADAM. We present evidence that thermodynamic parameterization methods can be (i) faster, (ii) more accurate, and (iii) more robust than standard algorithms incorporated into machine learning frameworks, in particular for data sets with complicated loss landscapes. Moreover, we show in numerical studies that methods based on sampling excite many degrees of freedom. The equipartition property, which is a consequence of their ergodicity, means that these methods keep in play an ensemble of low-loss states during the training process. By drawing parameter states from a sufficiently rich distribution of nearby candidate states, we show that the thermodynamic schemes produce smoother classifiers, improve generalization and reduce overfitting compared to traditional optimizers.


Developing and Deploying a Churn Prediction Model with Azure Machine Learning Services - Developer Blog

#artificialintelligence

Our sequential non-text information is best harnessed in a Bidirectional LSTM โ€“ a type of sequential model described in more detail here and here โ€“ that allows the model to learn end-of-sequence and beginning-of-sequence behavior. This maps to domain experts' knowledge that distinctive behavior at the end of the subscription period presages churn. It also captures the patterns in the progression of events over time that can be used to predict eventual churn. On the other hand our textual and categorical data need a separate model to learn from this differently structured data. We have several options here.


Artificial Intelligence & Data Science Training Services โ€“ neXt Era Technologies

#artificialintelligence

Our training programs are practical fast-paced programs to get you into Artificial Intelligence and Data Science domain and its sub-fields immediately. Our training programs consist of four Courses: Big Data Management, Data Analytics & Visualization, Machine Learning, Deep Learning and Computer Vision. Please leave this field empty. Please leave this field empty. Artificial Intelligence (AI) is a field that has a long history but is still constantly and actively growing and changing.


How do teams work together on an automated machine learning project?

#artificialintelligence

Each iteration runs within an experiment and stores serialized pipelines from the automated machine learning iterations until they retrieve the pipeline with the best performance on the validation data set. Once the evaluation has been performed, the data scientist, project manager, and business lead meet again to review the forecasting results. It's the project manager and business lead's job to make sense of the outputs and choose practical steps based on those results. The business lead needs to confirm that the best model and pipeline meet the business objective and that the machine learning solution answers the questions with acceptable accuracy to deploy the system to production for use by their internal sales forecasting application. Automated machine learning is based on a breakthrough from the Microsoft Research division. The approach combines ideas from collaborative filtering and Bayesian optimization to search an enormous space of possible machine learning pipelines intelligently and efficiently.



Artificial Intelligence Firearm Detection For K-12 Schools and Colleges

#artificialintelligence

By routing your camera feeds to our AI Engine, you can be informed in just 3 seconds when a firearm is detected in surveillance cameras. Additionally, this AI technology can track shooters in real time, providing shooter location(s) and fast live updates to police, school security and educators. In the wake of school shooting incidents over the past 10 years, people are anxious about creating safe environments. The ability to detect weapons on premises is unfortunately a necessity now. Cameras are already in place at most schools.