Genre
Next Big Future: IBM Watson Artificial Intelligence XPRIZE -Using AI in new ways to solve the World's biggest problems #Gsummit
IBM Watson Artificial Intelligence XPRIZE -Using AI in new ways to solve the World's biggest problems #Gsummit At the Singularity University Global Summit 2016, Nextbigfuture interviewed Amir Banifatemi who is managing the IBM Watson AI XPRIZE. Amir Banifatemi is a founder and managing partner at K5 Ventures. He focuses on working with startups and growth-oriented companies on products and initiatives that could trigger significant breakthrough with strong economic and societal impact. He has a special emphasis on machine learning and predictive systems, IoT, knowledge sharing and crowdsourcing, Education, and digital health. The IBM Watson AI XPRIZE is a 5 million AI and cognitive computing competition challenging teams globally to develop and demonstrate how humans can collaborate with powerful AI technologies to tackle the world's grand challenges.
Distributed Processing of Biosignal-Database for Emotion Recognition with Mahout
Kollia, Varvara, Elibol, Oguz H.
There are many popular emotion definitions and models, both in terms of discrete emotion subsets, as well as mappings in two-and three-dimensional spaces. In this work, we assume a 3D emotional model. With increasing interest in the area, new and large datasets are being collected, enabling new insights to be discovered in the area. These datasets necessitate distributed processing for enhanced scalability and performance. Popular distributed machine learning libraries can augment the process of training accurate classifiers offline, to build prediction models based on large amounts of data. We used Mahout on distributed mode to train a random forest classifier, on the DEAP dataset. Using a distributed approach allowed us to both process the data in reasonable time and conduct many iterations to experiment with different model parameters and convergence criteria.
DiSMEC - Distributed Sparse Machines for Extreme Multi-label Classification
Babbar, Rohit, Shoelkopf, Bernhard
Extreme multi-label classification refers to supervised multi-label learning involving hundreds of thousands or even millions of labels. Datasets in extreme classification exhibit fit to power-law distribution, i.e. a large fraction of labels have very few positive instances in the data distribution. Most state-of-the-art approaches for extreme multi-label classification attempt to capture correlation among labels by embedding the label matrix to a low-dimensional linear sub-space. However, in the presence of power-law distributed extremely large and diverse label spaces, structural assumptions such as low rank can be easily violated. In this work, we present DiSMEC, which is a large-scale distributed framework for learning one-versus-rest linear classifiers coupled with explicit capacity control to control model size. Unlike most state-of-the-art methods, DiSMEC does not make any low rank assumptions on the label matrix. Using double layer of parallelization, DiSMEC can learn classifiers for datasets consisting hundreds of thousands labels within few hours. The explicit capacity control mechanism filters out spurious parameters which keep the model compact in size, without losing prediction accuracy. We conduct extensive empirical evaluation on publicly available real-world datasets consisting upto 670,000 labels. We compare DiSMEC with recent state-of-the-art approaches, including - SLEEC which is a leading approach for learning sparse local embeddings, and FastXML which is a tree-based approach optimizing ranking based loss function. On some of the datasets, DiSMEC can significantly boost prediction accuracies - 10% better compared to SLECC and 15% better compared to FastXML, in absolute terms.
Functorial Hierarchical Clustering with Overlaps
Culbertson, Jared, Guralnik, Dan P., Stiller, Peter F.
This work draws its inspiration from three important sources of research on dissimilarity-based clustering and intertwines those three threads into a consistent principled functorial theory of clustering. Those three are the overlapping clustering of Jardine and Sibson, the functorial approach of Carlsson and Mรฉmoli to partition-based clustering, and the Isbell/Dress school's study of injective envelopes. Carlsson and Mรฉmoli introduce the idea of viewing clustering methods as functors from a category of metric spaces to a category of clusters, with functoriality subsuming many desirable properties. Our first series of results extends their theory of functorial clustering schemes to methods that allow overlapping clusters in the spirit of Jardine and Sibson. This obviates some of the unpleasant effects of chaining that occur, for example with single-linkage clustering. We prove an equivalence between these general overlapping clustering functors and projections of weight spaces to what we term clustering domains, by focusing on the order structure determined by the morphisms. As a specific application of this machinery, we are able to prove that there are no functorial projections to cut metrics, or even to tree metrics. Finally, although we focus less on the construction of clustering methods (clustering domains) derived from injective envelopes, we lay out some preliminary results, that hopefully will give a feel for how the third leg of the stool comes into play.
Random matrices meet machine learning: a large dimensional analysis of LS-SVM
Liao, Zhenyu, Couillet, Romain
This article proposes a performance analysis of kernel least squares support vector machines (LS-SVMs) based on a random matrix approach, in the regime where both the dimension of data $p$ and their number $n$ grow large at the same rate. Under a two-class Gaussian mixture model for the input data, we prove that the LS-SVM decision function is asymptotically normal with means and covariances shown to depend explicitly on the derivatives of the kernel function. This provides improved understanding along with new insights into the internal workings of SVM-type methods for large datasets.
Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiation
Townsend, James, Koep, Niklas, Weichwald, Sebastian
Optimization on manifolds is a class of methods for optimization of an objective function, subject to constraints which are smooth, in the sense that the set of points which satisfy the constraints admits the structure of a differentiable manifold. While many optimization problems are of the described form, technicalities of differential geometry and the laborious calculation of derivatives pose a significant barrier for experimenting with these methods. We introduce Pymanopt (available at https://pymanopt.github.io), a toolbox for optimization on manifolds, implemented in Python, that---similarly to the Manopt Matlab toolbox---implements several manifold geometries and optimization algorithms. Moreover, we lower the barriers to users further by using automated differentiation for calculating derivative information, saving users time and saving them from potential calculation and implementation errors.
A Mathematical Formalization of Hierarchical Temporal Memory's Spatial Pooler
Mnatzaganian, James, Fokouรฉ, Ernest, Kudithipudi, Dhireesha
IERARCHICAL temporal memory (HTM) is a machine learning algorithm that was inspired by the neocortex and designed to learn sequences and make predictions. In its idealized form, it should be able to produce generalized representations for similar inputs. Given time-series data, HTM should be able to use its learned representations to perform a type of time-dependent regression. Such a system would prove to be incredibly useful in many applications utilizing spatiotemporal data. One instance for using HTM with timeseries data was recently demonstrated by Cui et al. [1], where HTM was used to predict taxi passenger counts. The use of HTM in other applications remains unexplored, largely due to the evolving nature of HTM's algorithmic definition. Additionally, the lack of a formalized mathematical model hampers its prominence in the machine learning community. This work aims to bridge the gap between a neuroscience inspired algorithm and a math-based algorithm by constructing a purely mathematical framework around HTM's original algorithmic definition.
Multivariate Dependence Beyond Shannon Information
James, Ryan G., Crutchfield, James P.
Accurately determining dependency structure is critical to discovering a system's causal organization. We recently showed that the transfer entropy fails in a key aspect of this---measuring information flow---due to its conflation of dyadic and polyadic relationships. We extend this observation to demonstrate that this is true of all such Shannon information measures when used to analyze multivariate dependencies. This has broad implications, particularly when employing information to express the organization and mechanisms embedded in complex systems, including the burgeoning efforts to combine complex network theory with information theory. Here, we do not suggest that any aspect of information theory is wrong. Rather, the vast majority of its informational measures are simply inadequate for determining the meaningful dependency structure within joint probability distributions. Therefore, such information measures are inadequate for discovering intrinsic causal relations. We close by demonstrating that such distributions exist across an arbitrary set of variables.
We will happily be having sex with robots soon, according to scientists
Nasa has announced that it has found evidence of flowing water on Mars. Scientists have long speculated that Recurring Slope Lineae -- or dark patches -- on Mars were made up of briny water but the new findings prove that those patches are caused by liquid water, which it has established by finding hydrated salts. Several hundred camped outside the London store in Covent Garden. The 6s will have new features like a vastly improved camera and a pressure-sensitive "3D Touch" display