In many healthcare settings, intuitive decision rules for risk stratification can help effective hospital resource allocation. This paper introduces a novel variant of decision tree algorithms that produces a chain of decisions, not a general tree. Our algorithm, $\alpha$-Carving Decision Chain (ACDC), sequentially carves out "pure" subsets of the majority class examples. The resulting chain of decision rules yields a pure subset of the minority class examples. Our approach is particularly effective in exploring large and class-imbalanced health datasets. Moreover, ACDC provides an interactive interpretation in conjunction with visual performance metrics such as Receiver Operating Characteristics curve and Lift chart.

Ordinary least squares (OLS) is the default method for fitting linear models, but is not applicable for problems with dimensionality larger than the sample size. For these problems, we advocate the use of a generalized version of OLS motivated by ridge regression, and propose two novel three-step algorithms involving least squares fitting and hard thresholding. The algorithms are methodologically simple to understand intuitively, computationally easy to implement efficiently, and theoretically appealing for choosing models consistently. Numerical exercises comparing our methods with penalization-based approaches in simulations and data analyses illustrate the great potential of the proposed algorithms.

FAIRFAX, VA--(Marketwired - June 15, 2016) - Invincea, the leader in advanced endpoint threat protection, announced today that it is the first machine learning based endpoint security company to join the Anti-Malware Testing Standards Organization (AMTSO). Participation in AMTSO furthers Invincea's mission of addressing the global need for improvement in third party testing based on scientific objectivity, quality, and relevance of anti-malware testing methodologies. Hundreds of millions of new pieces of malware are created a year, wreaking havoc on enterprises across industries against the backdrop of obsolete anti-malware approaches. To combat the scourge of malware that evades traditional anti-malware systems, the next-gen endpoint security market has exploded with new companies bringing products to market with fantastic claims. To date, these companies have not been held accountable to their marketing claims by independent scientifically valid testing on the merits of their product technology and approaches.

Date Science, or Machine Learning, is a scary topic. It's hard to know where to get started. It's hard to even find a good definition of what it does and what you have to do. As I've given a few ad hoc presentations on Machine Learning (and though focused on implementing it with Azure, the basics are applicable to other platforms) I thought I'd take my random notes and present them as a primer. You don't need to be a Rocket Scientist to get started, but having a basic understanding of Linear Algebra will be helpful.

Approximate variational inference has shown to be a powerful tool for modeling unknown complex probability distributions. Recent advances in the field allow us to learn probabilistic models of sequences that actively exploit spatial and temporal structure. We apply a Stochastic Recurrent Network (STORN) to learn robot time series data. Our evaluation demonstrates that we can robustly detect anomalies both off- and on-line.

The estimation of class prevalence, i.e., the fraction of a population that belongs to a certain class, is a very useful tool in data analytics and learning, and finds applications in many domains such as sentiment analysis, epidemiology, etc. For example, in sentiment analysis, the objective is often not to estimate whether a specific text conveys a positive or a negative sentiment, but rather estimate the overall distribution of positive and negative sentiments during an event window. A popular way of performing the above task, often dubbed quantification, is to use supervised learning to train a prevalence estimator from labeled data. Contemporary literature cites several performance measures used to measure the success of such prevalence estimators. In this paper we propose the first online stochastic algorithms for directly optimizing these quantification-specific performance measures. We also provide algorithms that optimize hybrid performance measures that seek to balance quantification and classification performance. Our algorithms present a significant advancement in the theory of multivariate optimization and we show, by a rigorous theoretical analysis, that they exhibit optimal convergence. We also report extensive experiments on benchmark and real data sets which demonstrate that our methods significantly outperform existing optimization techniques used for these performance measures.

Heterogeneity is often natural in many contemporary applications involving massive data. While posing new challenges to effective learning, it can play a crucial role in powering meaningful scientific discoveries through the understanding of important differences among subpopulations of interest. In this paper, we exploit multiple networks with Gaussian graphs to encode the connectivity patterns of a large number of features on the subpopulations. To uncover the heterogeneity of these structures across subpopulations, we suggest a new framework of tuning-free heterogeneity pursuit (THP) via large-scale inference, where the number of networks is allowed to diverge. In particular, two new tests, the chi-based test and the linear functional-based test, are introduced and their asymptotic null distributions are established. Under mild regularity conditions, we establish that both tests are optimal in achieving the testable region boundary and the sample size requirement for the latter test is minimal. Both theoretical guarantees and the tuning-free feature stem from efficient multiple-network estimation by our newly suggested approach of heterogeneous group square-root Lasso (HGSL) for high-dimensional multi-response regression with heterogeneous noises. To solve this convex program, we further introduce a tuning-free algorithm that is scalable and enjoys provable convergence to the global optimum. Both computational and theoretical advantages of our procedure are elucidated through simulation and real data examples.

This week researchers demonstrated that by analyzing a person's Web searches they could in some cases predict an upcoming diagnosis of pancreatic cancer. Unlike traditional medical professionals, they have the advantage of access to a trove of data that Microsoft collects through its search engine, Bing. The Microsoft researchers identified Web users who had recently searched for queries indicating they have pancreatic cancer, such as "I was told I have pancreatic cancer, what to expect," and then looked back months earlier to examine patterns in the symptoms that the users searched for. This included phrases such as "dark or tarry stool," "abdominal swelling," "dark urine" and "yellowing skin." From this analysis they realized trends in the queries of users who were soon to be diagnosed with pancreatic cancer, identifying 5 to 15 percent of cases with low false-positive rates.

Early diagnosis is key to gaining the upper hand against a wide range of diseases. Now Microsoft researchers are suggesting that records of the topics that people search for on the Internet could one day prove as useful as an X-ray or MRI in detecting some illnesses before it's too late. The potential of using engagement with search engines to predict an eventual diagnosis – and possibly buy critical time for a medical response -- is demonstrated in a new study by Microsoft researchers Eric Horvitz and Ryen White, along with former Microsoft intern and Columbia University doctoral candidate John Paparrizos. In a paper published Tuesday in the Journal of Oncology Practice, the trio detailed how they used anonymized Bing search logs to identify people whose queries provided strong evidence that they had recently been diagnosed with pancreatic cancer – a particularly deadly and fast-spreading cancer that is frequently caught too late to cure. Then they retroactively analyzed searches for symptoms of the disease over many months prior to identify patterns of queries most likely to signal an eventual diagnosis.

This invention relates generally to image processing and, more particularly, to object detection using machine learning. Face detection systems perform image processing on digital images or video frames to automatically identify people. In one approach, face detection systems classify images into positive images that contain faces and negative images without any faces. Face detection systems may train neural network for detecting faces and separating the faces from backgrounds. By separating faces from backgrounds, face detection systems may determine whether images contain faces. A good face detection system should have a low rate of false positive detection (i.e., erroneously detecting a negative image as a positive image) and a high rate of true positive detection (i.e. Face detection remains challenging because the number of positive images and negative images available for training typically are not balanced. For example, there may be many more negative images than positive images, and the neural network may be trained in a biased manner with too many negative images. As a result, the neural network trained with the imbalance number of positive and negative samples may suffer from low accuracy in face detection with high false positive detection rate or low true positive detection rate. Face detection also remains challenging because facial appearance may be irregular with large variance. For example, faces may be deformed because of subjects having varying poses or expressions. In addition, faces may be deformed by external settings such as lighting conditions, occlusions, etc. As a result, neural network may fail to distinguish faces from backgrounds and cause a high false positive detection rate. Thus, there is a need for good approaches to accurate face detection and detection of other objects.