Goto

Collaborating Authors

 Country


The Noise Collector for sparse recovery in high dimensions

arXiv.org Machine Learning

The Noise Collector for sparse recovery in high dimensions Miguel Moscoso, Alexei Novikov †, George Papanicolaou ‡, Chrysoula Tsogka § August 14, 2019 Abstract The ability to detect sparse signals from noisy high-dimensional data is a top priority in modern science and engineering. A sparse solution of the linear system A ρ b 0 can be found efficiently with an null 1-norm minimization approach if the data is noiseless. Detection of the signal's support from data corrupted by noise is still a challenging problem, especially if the level of noise must be estimated. We propose a new efficient approach that does not require any parameter estimation. We introduce the Noise Collector (NC) matrix C and solve an augmented system A ρ C η b 0 e, where e is the noise. We show that the l 1-norm minimal solution of the augmented system has zero false discovery rate for any level of noise and with probability that tends to one as the dimension of b 0 increases to infinity. We also obtain exact support recovery if the noise is not too large, and develop a Fast Noise Collector Algorithm which makes the computational cost of solving the augmented system comparable to that of the original one. Finally, we demonstrate the effectiveness of the method in applications to passive array imaging. In the noiseless case, ρ can be found exactly by solving the optimization problem [9] ρ arg min ρ null ρnull null 1, subject to A ρ b, (2) provided the measurement matrix A R N K satisfies additional conditions, e.g., decoherence or restricted isometry properties [11, 4], and the solution vector ρ has a small number M of nonzero components or degrees of freedom.


Unsupervised Context Retrieval for Long-tail Entities

arXiv.org Artificial Intelligence

Monitoring entities in media streams often relies on rich entity representations, like structured information available in a knowledge base (KB). For long-tail entities, such monitoring is highly challenging, due to their limited, if not entirely missing, representation in the reference KB. In this paper, we address the problem of retrieving textual contexts for monitoring long-tail entities. We propose an unsupervised method to overcome the limited representation of long-tail entities by leveraging established entities and their contexts as support information. Evaluation on a purpose-built test collection shows the suitability of our approach and its robustness for out-of-KB entities.


Chatter Detection in Turning Using Machine Learning and Similarity Measures of Time Series via Dynamic Time Warping

arXiv.org Machine Learning

Chatter detection from sensor signals has been an active field of research. While some success has been reported using several featurization tools and machine learning algorithms, existing methods have several drawbacks such as manual preprocessing and requiring a large data set. In this paper, we present an alternative approach for chatter detection based on K-Nearest Neighbor (kNN) algorithm for classification and the Dynamic Time Warping (DTW) as a time series similarity measure. The used time series are the acceleration signals acquired from the tool holder in a series of turning experiments. Our results, show that this approach achieves detection accuracies that in most cases outperform existing methods. We compare our results to the traditional methods based on Wavelet Packet Transform (WPT) and the Ensemble Empirical Mode Decomposition (EEMD), as well as to the more recent Topological Data Analysis (TDA) based approach. We show that in three out of four cutting configurations our DTW-based approach attains the highest average classification rate reaching in one case as high as 99% accuracy. Our approach does not require feature extraction, is capable of reusing a classifier across different cutting configurations, and it uses reasonably sized training sets. Although the resulting high accuracy in our approach is associated with high computational cost, this is specific to the DTW implementation that we used. Specifically, we highlight available, very fast DTW implementations that can even be implemented on small consumer electronics. Therefore, further code optimization and the significantly reduced computational effort during the implementation phase make our approach a viable option for in-process chatter detection.


The HSIC Bottleneck: Deep Learning without Back-Propagation

arXiv.org Machine Learning

We introduce the HSIC (Hilbert-Schmidt independence criterion) bottleneck for training deep neural networks. The HSIC bottleneck is an alternative to conventional backpropagation, that has a number of distinct advantages. The method facilitates parallel processing and requires significantly less operations. It does not suffer from exploding or vanishing gradients. It is biologically more plausible than backpropagation as there is no requirement for symmetric feedback. We find that the HSIC bottleneck provides a performance on the MNIST/FashionMNIST/CIFAR10 classification comparable to backpropagation with a cross-entropy target, even when the system is not encouraged to make the output resemble the classification labels. Appending a single layer trained with SGD (without backpropagation) results in state-of-the-art performance.


Unsupervised Representations of Pollen in Bright-Field Microscopy

arXiv.org Artificial Intelligence

We present the first unsupervised deep learning method for pollen analysis using bright-field microscopy. Using a modest dataset of 650 images of pollen grains collected from honey, we achieve family level identification of pollen. We embed images of pollen grains into a low-dimensional latent space and compare Euclidean and Riemannian metrics on these spaces for clustering. We propose this system for automated analysis of pollen and other microscopic biological structures which have only small or unlabelled datasets available.


NeuroMask: Explaining Predictions of Deep Neural Networks through Mask Learning

arXiv.org Machine Learning

Deep Neural Networks (DNNs) deliver state-of-the-art performance in many image recognition and understanding applications. However, despite their outstanding performance, these models are black-boxes and it is hard to understand how they make their decisions. Over the past few years, researchers have studied the problem of providing explanations of why DNNs predicted their results. However, existing techniques are either obtrusive, requiring changes in model training, or suffer from low output quality. In this paper, we present a novel method, NeuroMask, for generating an interpretable explanation of classification model results. When applied to image classification models, NeuroMask identifies the image parts that are most important to classifier results by applying a mask that hides/reveals different parts of the image, before feeding it back into the model. The mask values are tuned by minimizing a properly designed cost function that preserves the classification result and encourages producing an interpretable mask. Experiments using state-of-the-art Convolutional Neural Networks for image recognition on different datasets (CIFAR-10 and ImageNet) show that NeuroMask successfully localizes the parts of the input image which are most relevant to the DNN decision. By showing a visual quality comparison between NeuroMask explanations and those of other methods, we find NeuroMask to be both accurate and interpretable.


The power of dynamic social networks to predict individuals' mental health

arXiv.org Machine Learning

Precision medicine has received attention both in and outside the clinic. We focus on the latter, by exploiting the relationship between individuals' social interactions and their mental health to develop a predictive model of one's likelihood to be depressed or anxious from rich dynamic social network data. To our knowledge, we are the first to do this. Existing studies differ from our work in at least one aspect: they do not model social interaction data as a network; they do so but analyze static network data; they examine "correlation" between social networks and health but without developing a predictive model; or they study other individual traits but not mental health. In a systematic and comprehensive evaluation, we show that our predictive model that uses dynamic social network data is superior to its static network as well as non-network equivalents when run on the same data.


Fully-automated patient-level malaria assessment on field-prepared thin blood film microscopy images, including Supplementary Information

arXiv.org Machine Learning

--Malaria is a life-threatening disease affecting millions. Microscopy-based assessment of thin blood films is a standard method to (i) determine malaria species and (ii) quanti-tate high-parasitemia infections. Full automation of malaria microscopy by machine learning (ML) is a challenging task because field-prepared slides vary widely in quality and presentation, and artifacts often heavily outnumber relatively rare parasites. In this work, we describe a complete, fully-automated framework for thin film malaria analysis that applies ML methods, including convolutional neural nets (CNNs), trained on a large and diverse dataset of field-prepared thin blood films. Quanti-tation and species identification results are close to sufficiently accurate for the concrete needs of drug resistance monitoring and clinical use-cases on field-prepared samples. We focus our methods and our performance metrics on the field use-case requirements. We discuss key issues and important metrics for the application of ML methods to malaria microscopy. Index T erms --malaria, automated microscopy, deep neural networks, gradient boosted trees I. I NTRODUCTION Malaria is a mosquito-borne disease caused by Plasmodium species ( P . Manual microscopy examination of Giemsa-stained blood films is a widespread malaria diagnosis method. Key use-cases include diagnosis; species identification (ID) to guide treatment [2]; and quantitation of parasites for drug resistance studies, to track how fast a drug clears parasites from the blood. However, a lack of training, high inter-sample variability in preparation and presentation, and difficult field conditions can result in poor accuracy [3], [4]. Also, lack of trained personnel limits the number of drug resistance sentinel sites. Malaria microscopy is a difficult task for automated image-processing and machine learning (ML) systems for two reasons: Field-prepared blood films vary widely in quality and presentation; and parasites are small (with feature size close to optical limits of resolution), rare, highly variable, and easily confused with non-parasite objects (artifacts). But it is also a high-value target, due to the potential benefit for so many people, and also because automated systems have some concrete advantages: They can be widely deployed, solving the expert-training bottleneck; they can examine more blood volume per patient, reducing variability in quantitation caused by Poisson statistics; and their results are reproducible.


Some Developments in Clustering Analysis on Stochastic Processes

arXiv.org Machine Learning

Some Developments in Clustering Analysis on Stochastic Processes Qidi Peng Nan Rao † Ran Zhao ‡ Abstract We review some developments on clustering stochastic processes and come with the conclusion that asymptotically consistent clustering algorithms can be obtained when the processes are ergodic and the dissimilarity measure satisfies the triangle inequality. Examples are provided when the processes are distribution ergodic, covariance ergodic and locally asymptotically self-similar, respectively. Keywords: stochastic process, unsupervised clustering, stationary ergodic processes, local asymptotic self-similarity 1 Introduction A stochastic process is an infinite sequence of random variables indexed by "time". The time indexes can be either discrete or continuous. Stochastic process type data have been broadly explored in biological and medical research (Damian et al., 2007; Zhao et al., 2014; J a askinen et al., 2014; et al., 2018).


The Myths of Our Time: Fake News

arXiv.org Machine Learning

While the purpose of most fake news is misinformation and political propaganda, our team sees it as a new type of myth that is created by people in the age of internet identities and artificial intelligence. Seeking insights on the fear and desire hidden underneath these modified or generated stories, we use machine learning methods to generate fake articles and present them in the form of an online news blog. This paper aims to share the details of our pipeline and the techniques used for full generation of fake news, from dataset collection to presentation as a media art project on the internet. Keywords: Fake news, Article generation, LSTM, RNN, Language model, Machine learning, AI, Media art, Internet art, Web, Blog, Human-AI Co-Creation Introduction Is fake news a new type of myth that people are creating in the age of internet and artificial intelligence? K. Shu et al says fake news can have many definitions, and one narrow definition is "a news article that is intentionally and verifiably false."