Goto

Collaborating Authors

 Learning Graphical Models


Natural Language Processing

#artificialintelligence

Originally published on Towards AI the World's Leading AI and Technology News and Media Company. If you are building an AI-related product or service, we invite you to consider becoming an AI sponsor. At Towards AI, we help scale AI and technology startups. Let us help you unleash your technology to the masses. The recommendation systems (RS) are becoming an integral part of our daily lives. This means that we can obtain what we desire either through internet-accessible applications or on social media channels. Traditional views of the recommendation problem refer to it as a simple classification or prediction problem; however, recently new evidence indicates that it is essentially a sequential problem[1]. It can therefore be formulated as a Markov decision process (MDP) and reinforcement learning (RL) methods can be employed to resolve it [1]. RL algorithms play a crucial role as these algorithms are very advantageous to cope with the dynamic environment and large space [4]. Deep Reinforcement Learning (DRL), have enabled RL to be applied to the recommendation problem with massive states and action spaces. RL-based and DRL-based methods in a classified manner based on the specific RL algorithm, like Q-learning, SARSA, and REINFORCE, that is used to optimize the recommendation policy[2].



Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy

arXiv.org Machine Learning

Bayesian additive regression trees have seen increased interest in recent years due to their ability to combine machine learning techniques with principled uncertainty quantification. The Bayesian backfitting algorithm used to fit BART models, however, limits their application to a small class of models for which conditional conjugacy exists. In this article, we greatly expand the domain of applicability of BART to arbitrary \emph{generalized BART} models by introducing a very simple, tuning-parameter-free, reversible jump Markov chain Monte Carlo algorithm. Our algorithm requires only that the user be able to compute the likelihood and (optionally) its gradient and Fisher information. The potential applications are very broad; we consider examples in survival analysis, structured heteroskedastic regression, and gamma shape regression.


Machine Learning, Deep Learning and Bayesian Learning

#artificialintelligence

This is a course on Machine Learning, Deep Learning (Tensorflow PyTorch) and Bayesian Learning (yes all 3 topics in one place!!!). This is a course on Machine Learning, Deep Learning (Tensorflow PyTorch) and Bayesian Learning (yes all 3 topics in one place!!!). We start off by analysing data using pandas, and implementing some algorithms from scratch using Numpy. These algorithms include linear regression, Classification and Regression Trees (CART), Random Forest and Gradient Boosted Trees. We start off using TensorFlow for our Deep Learning lessons.


2022 Machine Learning A to Z : 5 Machine Learning Projects

#artificialintelligence

Evaluation metrics to analyze the performance of models Industry relevance of linear and logistic regression Mathematics behind KNN, SVM and Naive Bayes algorithms Implementation of KNN, SVM and Naive Bayes using sklearn Attribute selection methods- Gini Index and Entropy Mathematics behind Decision trees and random forest Boosting algorithms:- Adaboost, Gradient Boosting and XgBoost Different Algorithms for Clustering Different methods to deal with imbalanced data Correlation Filtering Content and Collaborative based filtering Singular Value Decomposition Different algorithms used for Time Series forecasting Hands on Real-World examples. To make sense out of this course, you should be well aware of linear algebra, calculus, statistics, probability and python programming language. To make sense out of this course, you should be well aware of linear algebra, calculus, statistics, probability and python programming language. This course is a perfect fit for you. This course will take you step by step into the world of Machine Learning.


Learning for Structured Prediction

#artificialintelligence

Structured prediction is the main term for supervised machine learning techniques. Those techniques are involved predicting structured objects, instead of scalar discrete or real values. Structured prediction models are normally trained by means of observed data. In which the true value is used to regulate model parameters similar to usually used supervised learning techniques. The process of prediction using a trained model and of training the aforementioned is frequently computationally infeasible.


Accurate Prediction and Uncertainty Estimation using Decoupled Prediction Interval Networks

arXiv.org Machine Learning

We propose a network architecture capable of reliably estimating uncertainty of regression based predictions without sacrificing accuracy. The current state-of-the-art uncertainty algorithms either fall short of achieving prediction accuracy comparable to the mean square error optimization or underestimate the variance of network predictions. We propose a decoupled network architecture that is capable of accomplishing both at the same time. We achieve this by breaking down the learning of prediction and prediction interval (PI) estimations into a two-stage training process. We use a custom loss function for learning a PI range around optimized mean estimation with a desired coverage of a proportion of the target labels within the PI range. We compare the proposed method with current state-of-the-art uncertainty quantification algorithms on synthetic datasets and UCI benchmarks, reducing the error in the predictions by 23 to 34% while maintaining 95% Prediction Interval Coverage Probability (PICP) for 7 out of 9 UCI benchmark datasets. We also examine the quality of our predictive uncertainty by evaluating on Active Learning and demonstrating 17 to 36% error reduction on UCI benchmarks.


Masked prediction tasks: a parameter identifiability view

arXiv.org Machine Learning

The vast majority of work in self-supervised learning, both theoretical and empirical (though mostly the latter), have largely focused on recovering good features for downstream tasks, with the definition of "good" often being intricately tied to the downstream task itself. This lens is undoubtedly very interesting, but suffers from the problem that there isn't a "canonical" set of downstream tasks to focus on -- in practice, this problem is usually resolved by competing on the benchmark dataset du jour. In this paper, we present an alternative lens: one of parameter identifiability. More precisely, we consider data coming from a parametric probabilistic model, and train a self-supervised learning predictor with a suitably chosen parametric form. Then, we ask whether we can read off the ground truth parameters of the probabilistic model from the optimal predictor. We focus on the widely used self-supervised learning method of predicting masked tokens, which is popular for both natural languages and visual data. While incarnations of this approach have already been successfully used for simpler probabilistic models (e.g. learning fully-observed undirected graphical models), we focus instead on latent-variable models capturing sequential structures -- namely Hidden Markov Models with both discrete and conditionally Gaussian observations. We show that there is a rich landscape of possibilities, out of which some prediction tasks yield identifiability, while others do not. Our results, borne of a theoretical grounding of self-supervised learning, could thus potentially beneficially inform practice. Moreover, we uncover close connections with uniqueness of tensor rank decompositions -- a widely used tool in studying identifiability through the lens of the method of moments.


A new LDA formulation with covariates

arXiv.org Machine Learning

The Latent Dirichlet Allocation (LDA) model is a popular method for creating mixed-membership clusters. Despite having been originally developed for text analysis, LDA has been used for a wide range of other applications. We propose a new formulation for the LDA model which incorporates covariates. In this model, a negative binomial regression is embedded within LDA, enabling straight-forward interpretation of the regression coefficients and the analysis of the quantity of cluster-specific elements in each sampling units (instead of the analysis being focused on modeling the proportion of each cluster, as in Structural Topic Models). We use slice sampling within a Gibbs sampling algorithm to estimate model parameters. We rely on simulations to show how our algorithm is able to successfully retrieve the true parameter values and the ability to make predictions for the abundance matrix using the information given by the covariates. The model is illustrated using real data sets from three different areas: text-mining of Coronavirus articles, analysis of grocery shopping baskets, and ecology of tree species on Barro Colorado Island (Panama). This model allows the identification of mixed-membership clusters in discrete data and provides inference on the relationship between covariates and the abundance of these clusters.


what-is-the-use-of-machine-learning-handwriting-recognition

#artificialintelligence

Recent Deep Learning advancements, such as the introduction of transformer topologies, have helped us accelerate our handwritten character recognition. Intelligent Character Recognition (ICR), is a term used to describe the process for recognizing handwritten content. ICR algorithms require more intelligence than ordinary OCR. This post will cover the challenges of handwritten text identification and the techniques that can be used to tackle them using deep learning and machine learning. In the healthcare/pharmaceutical industry, patient medication digitization is a serious issue. Roche processes millions of PDFs each day, processing petabytes in medical PDFs.