Goto

Collaborating Authors

 Statistical Learning


Book Reviews

AI Magazine

Parametric tests are only valid if the data satisfy certain assumptions. If these assumptions hold, they will, however, typically give more accurate results. The analysis of statistical learning theory has very much the flavor of a nonparametric statistical test. The weakness of pac, therefore, is that its results must hold true even in worst-case distributions. There is, however, a new twist to this story in that the more recent pacstyle results are able to take account of observed attributes of the function that has been chosen by the learner, for example, its margin on the training set.


Networks and Learning

AI Magazine

On 15-16 November 1989, I attended the Massachusetts Institute of Technology (MIT) Industrial Liaison Program entitled "Networks and Learning." The topic was neural networks, their power, potential, and promise. A dozen distinguished professors and researchers presented informative and entertaining talks to an audience of technically minded business executives and industrial researchers who subscribe to MIT's popular series of symposia offered through their Industrial Liaison Program. The Massachusetts Institute of Technology (MIT) Industrial Liaison Program, "Networks and Learning," was held 15-16 November 1989 at MIT. A dozen distinguished professors and researchers presented informative and entertaining talks to an audience of technically minded business executives and industrial researchers who subscribe to MIT's popular series of symposia offered through its Industrial Liaison Program.


Machine Learning, Machine Vision, and the Brain

AI Magazine

The problem of learning is arguably at the very core of the problem of intelligence, both biological and artificial. In this article, we review our work over the last 10 years in the area of supervised learning, focusing on three interlinked directions of research--(1) theory, (2) engineering applications (making intelligent software), and (3) neuroscience (understanding the brain's mechanisms of learnings)--that contribute to and complement each other. Because seeing is intelligence, learning is also becoming a key to the study of artificial and biological vision. In the last few years, both computer vision--which attempts to build machines that see--and visual neuroscience--which aims to understand how our visual system works--are undergoing a fundamental change in their approaches. Visual neuroscience is beginning to focus on the mechanisms that allow the cortex to adapt its circuitry and learn a new task.


Support Vector Machines and Kernel Methods

AI Magazine

Kernel methods, a new generation of learning algorithms, utilize techniques from optimization, statistics, and functional analysis to achieve maximal generality, flexibility, and performance. These algorithms are different from earlier techniques used in machine learning in many respects: For example, they are explicitly based on a theoretical model of learning rather than on loose analogies with natural learning systems or other heuristics. They come with theoretical guarantees about their performance and have a modular design that makes it possible to separately implement and analyze their components. They are not affected by the problem of local minima because their training amounts to convex optimization. In the last decade, a sizable community of theoreticians and practitioners has formed around these methods, and a number of practical applications have been realized.


Using Machine Learning to Design and Interpret Gene-Expression Microarrays

AI Magazine

Gene-expression microarrays, commonly called gene chips, make it possible to simultaneously measure the rate at which a cell or tissue is expressing--translating into a protein--each of its thousands of genes. One can use these comprehensive snapshots of biological activity to infer regulatory pathways in cells; identify novel targets for drug design; and improve the diagnosis, prognosis, and treatment planning for those suffering from disease. However, the amount of data this new technology produces is more than one can manually analyze. Hence, the need for automated analysis of microarray data offers an opportunity for machine learning to have a significant impact on biology and medicine. This article describes microarray technology, the data it produces, and the types of machine learning tasks that naturally arise with these data.


Machine Learning and Sensor Fusion for Estimating Continuous Energy Expenditure

AI Magazine

Since becoming commercially available in 2001, more than half a million users have used the system to track their physiological parameters and to achieve their individual health goals including weight loss. We describe several challenges that arise in applying machine-learning techniques to the healthcare domain and present various solutions utilized in the armband system. We demonstrate how machine-learning and multisensor datafusion techniques are critical to the system's success. It is well recognized that regular and accurate self-monitoring of physiological parameters and energy expenditure (calorie burn) can improve self-awareness of personal health by providing important feedback. Such awareness and tracking are prerequisites for cost-effective health management, illness reduction, health-conscious decision making, and long-term lifestyle changes.


Machine Learning for Personalized Medicine: Predicting Primary Myocardial Infarction from Electronic Health Records

AI Magazine

We apply two statistical relational learning (SRL) algorithms to the task of predicting primary myocardial infarction. We show that one SRL algorithm, relational functional gradient boosting, outperforms propositional learners particularly in the medically relevant high-recall region. We observe that both SRL algorithms predict outcomes better than their propositional analogs and suggest how our methods can augment current epidemiological practices. MIs are common and deadly, causing one in six deaths overall in the United States totaling 400,000 per year (Roger et al. 2011). Because of its medical significance, MI has been studied in depth, mostly in the fields of epidemiology and biostatistics, yet rarely in machine learning.


Statistical Anomaly Detection for Train Fleets

AI Magazine

The tool is currently used by several railway operators across the world to inspect and visualize the occurrence of "event messages" generated on the trains. The anomaly detection component helps the operators quickly to find significant deviations from normal behavior and to detect early indications for possible problems. The method used is based on Bayesian principal anomaly, which is a framework for parametric anomaly detection using Bayesian statistics. The savings in maintenance costs of using the tool comes mainly from avoiding costly breakdowns and have been estimated to be several million Euros per year for the tool. In the long run, it is expected that maintenance costs can be reduced by between 5 and 10 percent with the help of the tool. It has been used for fraud detection and intrusion detection for a long time, but in later years the usage has exploded to all kind of domains, like surveillance, industrial system monitoring, epidemiology, and so on. For an overview of different anomaly-detection methods and applications, see, for example, Chandola, Banerjee, and Kumar (2009). The approach taken in statistical anomaly detection is to use data from (predominantly normal) previous situations to build a statistical model of what is normal. New situations are compared against that model and are considered anomalous if they are too improbable to occur in that model. The Swedish Institute of Computer Science (SICS) has for several years developed methods for statistical anomaly detection based on a framework called Bayesian principal anomaly (Holst and Ekman 2011).


Emerging Applications for Intelligent Diabetes Management

AI Magazine

It is a difficult task for physicians, who must manually interpret large volumes of blood glucose data to tailor therapy to the needs of each patient. This paper describes three emerging applications that employ AI to ease this task: (1) case-based decision support for diabetes management; (2) machine-learning classification of blood glucose plots; and (3) support vector regression for blood glucose prediction. The first application provides decision support by detecting blood glucose control problems and recommending therapeutic adjustments to correct them. The second provides an automated screen for excessive glycemic variability. The third aims to build a hypoglycemia predictor that could alert patients to dangerously low blood glucose levels in time to take preventive action.


Time Series Analysis With Generalized Additive Models

@machinelearnbot

This article comes from Algobeans Layman tutorials in analytics. Whenever you spot a trend plotted against time, you would be looking at a time series. The de facto choice for studying financial market performance and weather forecasts, time series are one of the most pervasive analysis techniques because of its inextricable relation to time--we are always interested to foretell the future. One intuitive way to make forecasts would be to refer to recent time points. Today's stock prices would likely be more similar to yesterday's prices than those from five years ago.