Goto

Collaborating Authors

 Statistical Learning


MARS: Multivariate Adaptive Regression Splines -- How to Improve on Linear Regression?

#artificialintelligence

Machine Learning is making huge leaps forward, with an increasing number of algorithms enabling us to solve complex real-world problems. This story is part of a deep dive series explaining the mechanics of Machine Learning algorithms. In addition to giving you an understanding of how ML algorithms work, it also provides you with Python examples to build your own ML models. Before we dive into the specifics of MARS, I assume that you are already familiar with Linear Regression. Looking at the algorithm's full name -- Multivariate Adaptive Regression Splines -- you would be correct to guess that MARS belongs to the group of regression algorithms used to predict continuous (numerical) target variables.


Predicting best quality of wine using Linear Regression and PyTorch

#artificialintelligence

In this notebook we will predict the best quality of the wine using PyTorch and linear regression. If you haven't checked out my previous blog on Linear Regression check this out . First of all lets import required libraries.. Now lets analyse our dataset.. its important to analyse to see what we are dealing with.. Training Dataset: The sample of data used to fit the model. The actual dataset that we use to train the model (weights and biases in the case of a Neural Network). The model sees and learns from this data.


Natural Language Processing (NLP) in Python for Beginners

#artificialintelligence

Created by Laxmi Kant KGP Talkie Students also bought Unsupervised Machine Learning Hidden Markov Models in Python Machine Learning and AI: Support Vector Machines in Python Cutting-Edge AI: Deep Reinforcement Learning in Python Ensemble Machine Learning in Python: Random Forest, AdaBoost Deep Learning: Advanced Computer Vision (GANs, SSD, More!) Unsupervised Deep Learning in Python Preview this course GET COUPON CODE Description Welcome to KGP Talkie's Natural Language Processing course. It is designed to give you a complete understanding of Text Processing and Mining with the use of State-of-the-Art NLP algorithms in Python. We Learn Spacy and NLTK in details and we will also explore the uses of NLP in real-life. This course covers the basics of NLP to advance topics like word2vec, GloVe. In this course, we will start from level 0 to the advanced level.


Domain Adaptation for Robust Workload Level Alignment Between Sessions and Subjects using fNIRS

arXiv.org Artificial Intelligence

Significance: We demonstrated the potential of using domain adaptation on functional Near-Infrared Spectroscopy (fNIRS) data to classify different levels of n-back tasks that involve working memory. Aim: Domain shift in fNIRS data is a challenge in the workload level alignment across different experiment sessions and subjects. In order to address this problem, two domain adaptation approaches -- Gromov-Wasserstein (G-W) and Fused Gromov-Wasserstein (FG-W) were used. Approach: Specifically, we used labeled data from one session or one subject to classify trials in another session (within the same subject) or another subject. We applied G-W for session-by-session alignment and FG-W for subject-by-subject alignment to fNIRS data acquired during different n-back task levels. We compared these approaches with three supervised methods: multi-class Support Vector Machine (SVM), Convolutional Neural Network (CNN), and Recurrent Neural Network (RNN). Results: In a sample of six subjects, G-W resulted in an alignment accuracy of 68 $\pm$ 4 % (weighted mean $\pm$ standard error) for session-by-session alignment, FG-W resulted in an alignment accuracy of 55 $\pm$ 2 % for subject-by-subject alignment. In each of these cases, 25 % accuracy represents chance. Alignment accuracy results from both G-W and FG-W are significantly greater than those from SVM, CNN and RNN. We also showed that removal of motion artifacts from the fNIRS data plays an important role in improving alignment performance. Conclusions: Domain adaptation has potential for session-by-session and subject-by-subject alignment of mental workload by using fNIRS data.


Cluster Based Deep Contextual Reinforcement Learning for top-k Recommendations

arXiv.org Artificial Intelligence

Rapid advancements in the E-commerce sector over the last few decades have led to an imminent need for personalised, efficient and dynamic recommendation systems. To sufficiently cater to this need, we propose a novel method for generating top-k recommendations by creating an ensemble of clustering with reinforcement learning. We have incorporated DB Scan clustering to tackle vast item space, hence in-creasing the efficiency multi-fold. Moreover, by using deep contextual reinforcement learning, our proposed work leverages the user features to its full potential. With partial updates and batch updates, the model learns user patterns continuously. The Duelling Bandit based exploration provides robust exploration as compared to the state-of-art strategies due to its adaptive nature. Detailed experiments conducted on a public dataset verify our claims about the efficiency of our technique as com-pared to existing techniques.


Language Generation via Combinatorial Constraint Satisfaction: A Tree Search Enhanced Monte-Carlo Approach

arXiv.org Artificial Intelligence

Generating natural language under complex constraints is a principled formulation towards controllable text generation. We present a framework to allow specification of combinatorial constraints for sentence generation. We propose TSMH, an efficient method to generate high likelihood sentences with respect to a pre-trained language model while satisfying the constraints. Our approach is highly flexible, requires no task-specific training, and leverages efficient constraint satisfaction solving techniques. To better handle the combinatorial constraints, a tree search algorithm is embedded into the proposal process of the Markov chain Monte Carlo (MCMC) to explore candidates that satisfy more constraints. Compared to existing MCMC approaches, our sampling approach has a better mixing performance. Experiments show that TSMH achieves consistent and significant improvement on multiple language generation tasks.


Persistent Reductions in Regularized Loss Minimization for Variable Selection

arXiv.org Machine Learning

In the context of regularized loss minimization with polyhedral gauges, we show that for a broad class of loss functions (possibly non-smooth and non-convex) and under a simple geometric condition on the input data it is possible to efficiently identify a subset of features which are guaranteed to have zero coefficients in all optimal solutions in all problems with loss functions from said class, before any iterative optimization has been performed for the original problem. This procedure is standalone, takes only the data as input, and does not require any calls to the loss function. Therefore, we term this procedure as a persistent reduction for the aforementioned class of regularized loss minimization problems. This reduction can be efficiently implemented via an extreme ray identification subroutine applied to a polyhedral cone formed from the datapoints. We employ an existing output-sensitive algorithm for extreme ray identification which makes our guarantee and algorithm applicable in ultra-high dimensional problems.


Machine Learning -- K-Nearest Neighbors algorithm with Python

#artificialintelligence

'K-Nearest Neighbors (KNN) is a model that classifies data points based on the points that are most similar to it. It uses test data to make an "educated guess" on what an unclassified point should be classified as' We will be building our KNN model using python's most popular machine learning package'scikit-learn'. Scikit-learn provides data scientists with various tools for performing machine learning tasks. For our KNN model, we are going to use the'KNeighborsClassifier' algorithm which is readily available in scikit-learn package. Finally, we will evaluate our KNN model predictions using the'accuracy score' function in scikit-learn.


Beginner's Guide to K-Nearest Neighbors in R: from Zero to Hero

#artificialintelligence

In the world of Machine Learning, I find the K-Nearest Neighbors (KNN) classifier makes the most intuitive sense and easily accessible to beginners even without introducing any math notations. To decide the label of an observation, we look at its neighbors and assign the neighbors' label to the observation of interest. Certainly, looking at one neighbor may create bias and inaccuracy, and the KNN method has a set of rules and procedures to determine the best number of neighbors, e.g., examining k 1 neighbors and adopt majority rule to decide the category. "To decide the label for new observations, we look at the closest neighbors." To choose the nearest neighbors, we have to define what distance is.


The Various Types of Artificial Intelligence Technologies

#artificialintelligence

Artificial Intelligence is a broad term that encompasses many techniques, all of which enable computers to display some level of intelligence similar to us humans. The most popular use of Artificial Intelligence is robots that are similar to super-humans at many different tasks. They can fight, fly, and have deeply insightful conversations about virtually any topic. There are many examples of robots in movies, both good and bad, like the Vision, Wall-E, Terminator, Ultron, etc. Though this is the holy grail of AI research, our current technology is very far from achieving that AI level, which we call General AI.