Genre
Predicting litigation likelihood and time to litigation for patents
Wongchaisuwat, Papis, Klabjan, Diego, McGinnis, John O.
Patent lawsuits are costly and time-consuming. An ability to forecast a patent litigation and time to litigation allows companies to better allocate budget and time in managing their patent portfolios. We develop predictive models for estimating the likelihood of litigation for patents and the expected time to litigation based on both textual and non-textual features. Our work focuses on improving the state-of-the-art by relying on a different set of features and employing more sophisticated algorithms with more realistic data. The rate of patent litigations is very low, which consequently makes the problem difficult. The initial model for predicting the likelihood is further modified to capture a time-to-litigation perspective.
Debugging Machine Learning Tasks
Chakarov, Aleksandar, Nori, Aditya, Rajamani, Sriram, Sen, Shayak, Vijaykeerthy, Deepak
Unlike traditional programs (such as operating systems or word processors) which have large amounts of code, machine learning tasks use programs with relatively small amounts of code (written in machine learning libraries), but voluminous amounts of data. Just like developers of traditional programs debug errors in their code, developers of machine learning tasks debug and fix errors in their data. However, algorithms and tools for debugging and fixing errors in data are less common, when compared to their counterparts for detecting and fixing errors in code. In this paper, we consider classification tasks where errors in training data lead to misclassifications in test points, and propose an automated method to find the root causes of such misclassifications. Our root cause analysis is based on Pearl's theory of causation, and uses Pearl's PS (Probability of Sufficiency) as a scoring metric. Our implementation, Psi, encodes the computation of PS as a probabilistic program, and uses recent work on probabilistic programs and transformations on probabilistic programs (along with gray-box models of machine learning algorithms) to efficiently compute PS. Psi is able to identify root causes of data errors in interesting data sets.
Predicting Glaucoma Visual Field Loss by Hierarchically Aggregating Clustering-based Predictors
Higaki, Motohide, Morino, Kai, Murata, Hiroshi, Asaoka, Ryo, Yamanishi, Kenji
This study addresses the issue of predicting the glaucomatous visual field loss from patient disease datasets. Our goal is to accurately predict the progress of the disease in individual patients. As very few measurements are available for each patient, it is difficult to produce good predictors for individuals. A recently proposed clustering-based method enhances the power of prediction using patient data with similar spatiotemporal patterns. Each patient is categorized into a cluster of patients, and a predictive model is constructed using all of the data in the class. Predictions are highly dependent on the quality of clustering, but it is difficult to identify the best clustering method. Thus, we propose a method for aggregating cluster-based predictors to obtain better prediction accuracy than from a single cluster-based prediction. Further, the method shows very high performances by hierarchically aggregating experts generated from several cluster-based methods. We use real datasets to demonstrate that our method performs significantly better than conventional clustering-based and patient-wise regression methods, because the hierarchical aggregating strategy has a mechanism whereby good predictors in a small community can thrive.
Nuclear norm penalization and optimal rates for noisy low rank matrix completion
Koltchinskii, Vladimir, Tsybakov, Alexandre B., Lounici, Karim
This paper deals with the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We propose a new nuclear norm penalized estimator of $A_0$ and establish a general sharp oracle inequality for this estimator for arbitrary values of $n,m_1,m_2$ under the condition of isometry in expectation. Then this method is applied to the matrix completion problem. In this case, the estimator admits a simple explicit form and we prove that it satisfies oracle inequalities with faster rates of convergence than in the previous works. They are valid, in particular, in the high-dimensional setting $m_1m_2\gg n$. We show that the obtained rates are optimal up to logarithmic factors in a minimax sense and also derive, for any fixed matrix $A_0$, a non-minimax lower bound on the rate of convergence of our estimator, which coincides with the upper bound up to a constant factor. Finally, we show that our procedure provides an exact recovery of the rank of $A_0$ with probability close to 1. We also discuss the statistical learning setting where there is no underlying model determined by $A_0$ and the aim is to find the best trace regression model approximating the data.
Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices
In recent years, deep neural networks (DNN) have demonstrated significant business impact in large scale analysis and classification tasks such as speech recognition, visual object detection, pattern extraction, etc. Training of large DNNs, however, is universally considered as time consuming and computationally intensive task that demands datacenter-scale computational resources recruited for many days. Here we propose a concept of resistive processing unit (RPU) devices that can potentially accelerate DNN training by orders of magnitude while using much less power. The proposed RPU device can store and update the weight values locally thus minimizing data movement during training and allowing to fully exploit the locality and the parallelism of the training algorithm. We identify the RPU device and system specifications for implementation of an accelerator chip for DNN training in a realistic CMOS-compatible technology. For large DNNs with about 1 billion weights this massively parallel RPU architecture can achieve acceleration factors of 30,000X compared to state-of-the-art microprocessors while providing power efficiency of 84,000 GigaOps/s/W. Problems that currently require days of training on a datacenter-size cluster with thousands of machines can be addressed within hours on a single RPU accelerator. A system consisted of a cluster of RPU accelerators will be able to tackle Big Data problems with trillions of parameters that is impossible to address today like, for example, natural speech recognition and translation between all world languages, real-time analytics on large streams of business and scientific data, integration and analysis of multimodal sensory data flows from massive number of IoT (Internet of Things) sensors.
'Super Hubble' has final flight mirror installed ahead of 2018 launch
The James Webb telescope will be the world biggest and most powerful telescope when it launches in 2018. Nasa describes it as a'time machine' that can peer back 200 million years after the Big Bang. This week, Nasa engineers in Maryland got a little closer to launch with the completion of testing on its science cameras and the installation of the final flight mirrors. NASA's James Webb Space Telescope completed primary mirror sits in the cleanroom at NASA Goddard Space Flight Center, and supported over it on the tripod is the secondary mirror After over a year of planning, nearly four months of final cold testing and monitoring, the testing on the science instruments module of the observatory was completed. They were removed from a giant thermal vacuum chamber at Nasa Goddard Space Flight Center in Greenbelt, Maryland called the Space Environment Simulator.
Is the machine learning specialization on Coursera from the Washington university worth the money? โข /r/MachineLearning
I will start by giving some background information. Currently I am a final year (graduation year) CS student who got interested in machine learning about 6 months ago. I started with the Andrew NG course from Coursera which I recently finished (about 3 weeks ago). When I finished the Coursera course I saw a suggestion that if you'd like to continue to learn more about machine learning you could follow the online Coursera specialization from the Washington university. In this AMA he suggested that if you'd like to learn more about machine learning one of the things you could do was to follow and complete the Coursera course from Andrew NG and their specialization course.
7 Ways Machine Learning Is Already Affecting Your World
What do you think of when someone says "AI" or "Artificial Intelligence"? For most of us, it conjures up an image of the future. It doesn't much evoke the here and now. Artificial intelligence is already out of the box. And while it might not be as slick as the movies, it has vast applications in almost every field, from business to medicine, traffic jams to Facebook photos. Most of us use or benefit from artificial intelligence every day.
Hidden decision trees revisited
Note that in the logistic regression, we use constrained regression coefficients. These coefficients depend on 2 or 3 top parameters and have the same sign as the correlation between the rule they represent, and the response or score. This make the regression non-sensitive to high cross correlations among the "independent" variables (rules) which are indeed not independent in this case. This approach is similar to ridge regression, logic regression or Lasso regression. The regression is used to fine tune the top parameters associated with regression coefficients.
Bay Area NLP (Natural Language Processing)
Stanford CoreNLP is an extensible, open source, JVM-based NLP toolkit with good quality core natural language analysis components, quite widely used in academia, companies, and government. This talk will give an overview, look at use from the command-line, code, and the web API, including the new server and new annotators, and provide a deeper dive going through a pipeline we recently built for a machine reading task. We'd also welcome questions (and requests!) from people who have used CoreNLP. We'll open at 7 and the talk will begin at 7:30, co-presented by Christopher Manning, Professor at Stanford University and Jason Bolton, Research Engineer at Stanford University.