Statistical Learning
Untapped opportunities in AI
Editor's note: this post is part of an ongoing series exploring developments in artificial intelligence. First, collect huge amounts of training data -- probably more than anyone thought sensible or even possible a decade ago. Second, massage and preprocess that data so the key relationships it contains are easily accessible (the jargon here is "feature engineering"). Finally, feed the result into ludicrously high-performance, parallelized implementations of pretty standard machine-learning methods like logistic regression, deep neural networks, and k-means clustering (don't worry if those names don't mean anything to you -- the point is that they're widely available in high-quality open source packages). Google pioneered this formula, applying it to ad placement, machine translation, spam filtering, YouTube recommendations, and even the self-driving car -- creating billions of dollars of value in the process.
Who are alike? Use BigObject feature vector to find similarities
Cluster Analysis is a common technique to group a set of objects in the way that the objects in the same group share certain attributes. It's commonly used in marketing and sales planning to define market segmentations. Here at BigObject we adopt a simple approach to exploring the similarities between objects. We simply calculate the "Feature Vector" based on given attributes and use the score to determine which objects are "alike." This is a simple example to show how to use BigObject to extract product features and then find similar products in your retail data.
Bilingual Distributed Word Representations from Document-Aligned Comparable Data
Vuliฤ, Ivan, Moens, Marie-Francine
We propose a new model for learning bilingual word representations from non-parallel document-aligned data. Following the recent advances in word representation learning, our model learns dense real-valued word vectors, that is, bilingual word embeddings (BWEs). Unlike prior work on inducing BWEs which heavily relied on parallel sentence-aligned corpora and/or readily available translation resources such as dictionaries, the article reveals that BWEs may be learned solely on the basis of document-aligned comparable data without any additional lexical resources nor syntactic information. We present a comparison of our approach with previous state-of-the-art models for learning bilingual word representations from comparable data that rely on the framework of multilingual probabilistic topic modeling (MuPTM), as well as with distributional local context-counting models. We demonstrate the utility of the induced BWEs in two semantic tasks: (1) bilingual lexicon extraction, (2) suggesting word translations in context for polysemous words. Our simple yet effective BWE-based models significantly outperform the MuPTM-based and context-counting representation models from comparable data as well as prior BWE-based models, and acquire the best reported results on both tasks for all three tested language pairs.
Encoding Lineage in Scholarly Articles
Naim, Sheikh Motahar (University of Texas at El Paso) | Kader, Md Abdul (University of Texas at El Paso) | Boedihardjo, Arnold P. (US Army Corps of Engineers) | Hossain, M. Shahriar (University of Texas at El Paso)
The development of new scientific concepts today is an outcome of the accumulated knowledge built over time. Every scientific domain requires understanding of the trends of the dependencies between its subdomains. Analyses of trends to capture such dependencies using conventional document modeling techniques is a challenging task due to two reasons: (1) conventional vector-space modeling based representation of documents does not realize the history of the content, and (2) neither feature-level nor document-level causality is provided with any digital library metadata or citation network. In this paper, we propose an intuitive temporal representation of a scientific article that encodes inherent historic characteristics of the content. This intuitive representation of each document is then leveraged to discover causal relationships between scientific articles. In addition, we provide a mechanism to explore the lineage of each document in terms of other previously published documents, which illustrates how the theme of the document under analysis evolved over time. Empirical studies reported in the paper show that the proposed technique identifies meaningful causal relationships and discovers meaningful lineage in the scientific literature that could not be discovered through the citation network of the articles.
Combining Multiple Concurrent Physiological Streams to Assessing Patients Condition
Hong, Shenda (Peking University) | Qiu, Zhen (Peking University) | Zhang, Jinbo (Peking University) | Li, Hongyan (Peking University)
Multiple concurrent physiological streams generated by various medical devices play important roles in patient condition assessment. However, these physiological streams needto be analyzed together and output in real-time for preciseand timely controlling and management, which poses a non-trivial challenge to existing methods. This paper presents ourresearch on real-time assessing based on this kind of data.To address this problem, we first extract sketches from original data with the help of adaptive sampling and wave splittingalgorithm, then define scalable operators on sketches and propose MUNCA (MUlti-dimensional Nearest Center Analysis)to combine these multiple concurrent data together for anal-ysis. Experiments on real data demonstrate the effectiveness and efficiency of the proposed method.
Predicting 30-Day Risk and Cost of "All-Cause" Hospital Readmissions
Sushmita, Shanu (University of Washington, Tacoma) | Khulbe, Garima (University of Washington, Tacoma) | Hasan, Aftab (University of Washington, Tacoma) | Newman, Stacey (University of Washington, Tacoma) | Ravindra, Padmashree (University of Washington, Tacoma) | Roy, Senjuti Basu (University of Washington, Tacoma) | Cock, Martine De (University of Washington, Tacoma) | Teredesai, Ankur (University of Washington, Tacoma)
The hospital readmission rate of patients within 30 days after discharge is broadly accepted as a healthcare quality measure and cost driver in the United States. The ability to estimate hospitalization costs alongside 30 day risk-stratification for such readmissions provides additional benefit for accountable care, now a global issue and foundation for the U.S.~government mandate under the Affordable Care Act. Recent data mining efforts either predict healthcare costs or risk of hospital readmission, but not both. In this paper we present a dual predictive modeling effort that utilizes healthcare data to predict the risk and cost of any hospital readmission (``all-cause''). For this purpose, we explore machine learning algorithms to do accurate predictions of healthcare costs and risk of 30-day readmission.Results on risk prediction for ``all-cause'' readmission compared to the standardized readmission tool (LACE) are promising, and the proposed techniques for cost prediction consistently outperform baseline models and demonstrate substantially lower mean absolute error (MAE).
Deep Activity Recognition Models with Triaxial Accelerometers
Alsheikh, Mohammad Abu (Nanyang Technological University) | Selim, Ahmed (Trinity College Dublin) | Niyato, Dusit (Nanyang Technological University) | Doyle, Linda (Trinity College Dublin) | Lin, Shaowei (Institute for Infocomm Research) | Tan, Hwee-Pink (Singapore Management University)
Despite the widespread installation of accelerometers in almost all mobile phones and wearable devices, activity recognition using accelerometers is still immature due to the poor recognition accuracy of existing recognition methods and the scarcity of labeled training data. We consider the problem of human activity recognition using triaxial accelerometers and deep learning paradigms. This paper shows that deep activity recognition models (a) provide better recognition accuracy of human activities, (b) avoid the expensive design of handcrafted features in existing systems, and (c) utilize the massive unlabeled acceleration samples for unsupervised feature extraction. We show substantial recognition improvement on real world datasets over state-of-the-art methods of human activity recognition using triaxial accelerometers.
Identifying Contributing Factors of Occupant Thermal Discomfort in a Smart Building
Basak, Aniruddha (Carnegie Mellon University, Silicon Valley Campus) | Mengshoel, Ole (Carnegie Mellon University, Silicon Valley Campus) | Hosein, Stefan (University of the West Indies, St. Augustine) | Martin, Rodney (NASA Ames Research Center) | Jayakumaran, Jayasudha (Carnegie Mellon University, Silicon Valley Campus) | Morga, Mario Gurrola (Zapopan's Superior Institute of Technology) | Aghav, Ishwari (Carnegie Mellon University, Silicon Valley Campus)
Modeling occupant behavior in smart buildings to reduce energy usage in a more accurate fashion has garnered much recent attention in the literature. Predicting occupant comfort in buildings is a related and challenging problem. In some smart buildings, such as NASA AMES Sustainability Base, there are discrepancies between occupants' actual thermal discomfort and sensors based upon a weighted average of wet bulb, dry bulb, and mean radiant temperature intended to characterize thermal comfort. In this paper we attempt to find other contributing factors to occupant discomfort. For our experiment we use a dataset from a Building Automation System (BAS) in NASA Sustainability Base. We choose one conference room for our experiment and empirically establish the thermal discomfort level for the room's temperature sensor. We use various causality metrics and causal graphs to isolate candidate causes of the target room temperature. And we compare these feature sets according to their predictive capability of future instances of discomfort. Moreover, we establish a trade off between computational and statistical performance of adverse event prediction.
Protecting Wildlife under Imperfect Observation
Nguyen, Thanh Hong (University of Southern California) | Sinha, Arunesh (University of Southern California) | Gholami, Shahrzad (University of Southern California) | Plumptre, Andrew ( Wildlife Conservation Society ) | Joppa, Lucas ( Microsoft Research ) | Tambe, Milind (University of Southern California) | Driciru, Margaret ( Uganda Wildlife Authority ) | Wanyama, Fred ( Uganda Wildlife Authority ) | Rwetsiba, Aggrey ( Uganda Wildlife Authority ) | Critchlow, Rob ( The University of York ) | Beale, Colin ( The University of York )
Wildlife poaching presents a serious extinction threat to many animal species. In order to save wildlife in designated wildlife parks, park rangers conduct patrols over the park area to combat such illegal activities. An important aspect of the patrolling activity of the rangers is to anticipate where the poachers are likely to catch animals and then respond accordingly. Previous work has applied defender-attacker Stackelberg Security Games (SSGs) to solve the problem of wildlife protection, wherein attacker behavioral models are used to predict the behaviors of the poachers. However, these behavioral models have several limitations which limit their accuracy in predicting poachers' behavior. First, existing models fail to account for the rangers' imperfect observations w.r.t poaching activities (due to the limited capability of rangers to patrol thoroughly over a vast geographical area). Second, these models are built upon discrete choice models that assume a single agent choosing targets, while it is infeasible to obtain information about every single attacker in wildlife protection. Third, these models do not consider the effect of past poachers' actions on the current poachers' activities, one of the key factors affecting the poachers' behaviors. In this work, we attempt to address these limitations while providing three main contributions. First, we propose a novel hierarchical behavioral model, HiBRID, to predict the poachers' behaviors wherein the rangers' imperfect detection of poaching signs is taken into account --- a significant advance towards existing behavioral models in security games. Furthermore, HiBRID incorporates the temporal effect on the poachers' behaviors. The model also does not require a known number of attackers. Second, we provide two new heuristics: \textit{parameter separation} and \textit{target abstraction} to reduce the computational complexity in learning the model parameters. Finally, we use the real-world data collected in Queen Elizabeth National Park (QENP) in Uganda over 12 years to evaluate the prediction accuracy of our new model.
Effect of Part-of-Speech and Lemmatization Filtering in Email Classification for Automatic Reply
Bonatti, Rogerio (Universidade de Sao Paulo) | Paula, Arthur G. de (Universidade de Sao Paulo) | Lamarca, Victor S. (Universidade de Sao Paulo) | Cozman, Fabio G. (Universidade de Sao Paulo)
We study the automatic reply of email business messages in Brazilian Portuguese. We present a novel corpus containing messages from a real application, and baseline categorization experiments using Naive Bayes and Support Vector Machines. We then discuss the effect of lemmatization and the role of part-of-speech tagging filtering on precision and recall. Support Vector Machines classification coupled with non-lemmatized selection of verbs and nouns, adjectives and adverbs was the best approach, with 87.3% maximum accuracy. Straightforward lemmatization in Portuguese led to the lowest classification results in the group, with 85.3% and 81.7% precision in SVM and Naive Bayes respectively. Thus, while lemmatization reduced precision and recall, part-of-speech filtering improved overall results.