Europe
Amazon backs German artificial intelligence research hub
FRANKFURT (Reuters) - Amazon.com will open an artificial intelligence research center in the German university city of Tuebingen, creating 100 jobs over the next five years. It joins BMW, Bosch, Daimler, Facebook and Porsche in backing a German initiative launched last year and focused on areas such as robotics, machine learning and computer vision. The research center will be located adjacent to the Max Planck Institute for Intelligent Systems and draw on the expertise of two of its experts, Prof. Bernhard Schoelkopf and Prof. Michael J. Black. Schoelkopf is co-inventor of technology that enables computers to understand causality. "It's at the heart of every decision taken by machine learning," said Ralf Herbrich, Amazon's director of machine learning.
China vs US: Who is winning the big AI battle? - TechNode
China and the US are becoming the world's biggest rivals in artificial intelligence: it's Luke vs Darth Vader, Alien vs Predator, Rocky vs Ivan Drago. The Chinese government's pivot to become the leader in this technology has created plenty of hype, but how are China's ambitious AI aspirations playing out on the ground? Research by startup database IT Juzi and Tencent News offers a new view of China's AI industry's strengths and weaknesses. The US is currently the definite champion in AI development, according to the data. There are 1.82 times more American AI companies than Chinese.
Word embeddings in 2017: Trends and future directions
The word2vec method based on skip-gram with negative sampling (Mikolov et al., 2013) [49] was published in 2013 and had a large impact on the field, mainly through its accompanying software package, which enabled efficient training of dense word representations and a straightforward integration into downstream models. In some respects, we have come far since then: Word embeddings have established themselves as an integral part of Natural Language Processing (NLP) models. In other aspects, we might as well be in 2013 as we have not found ways to pre-train word embeddings that have managed to supersede the original word2vec. This post will focus on the deficiencies of word embeddings and how recent approaches have tried to resolve them. If not otherwise stated, this post discusses pre-trained word embeddings, i.e. word representations that have been learned on a large corpus using word2vec and its variants.
Linux Foundation Debuts Community Data License Agreement
In an era of expansive and often underused data, the CDLA licenses are an effort to define a licensing framework to support collaborative communities built around curating and sharing "open" data. Inspired by the collaborative software development models of open source software, the CDLA licenses are designed to enable individuals and organizations of all types to share data as easily as they currently share open source software code. Soundly drafted licensing models can help people form communities to assemble, curate and maintain vast amounts of data, measured in petabytes and exabytes, to bring new value to communities of all types, to build new business opportunities and to power new applications that promise to enhance safety and services. The growth of big data analytics, machine learning and artificial intelligence (AI) technologies has allowed people to extract unprecedented levels of insight from data. Now the challenge is to assemble the critical mass of data for those tools to analyze.
Machine learning used to predict earthquakes in a lab setting
A group of researchers from the UK and the US have used machine learning techniques to successfully predict earthquakes. Although their work was performed in a laboratory setting, the experiment closely mimics real-life conditions, and the results could be used to predict the timing of a real earthquake. The team, from the University of Cambridge, Los Alamos National Laboratory and Boston University, identified a hidden signal leading up to earthquakes, and used this'fingerprint' to train a machine learning algorithm to predict future earthquakes. Their results, which could also be applied to avalanches, landslides and more, are reported in the journal Geophysical Review Letters. For geoscientists, predicting the timing and magnitude of an earthquake is a fundamental goal.
Alan Turing school report in Cambridge codebreaker exhibition
A school report stating World War Two codebreaker Alan Turing needed to buck up his ideas if he wanted to get into Cambridge University is going on public display for the first time. Turing's report from Sherborne School in Dorset warns: "He must remember that Cambridge will want sound knowledge rather than vague ideas." It forms part of a new Codebreakers and Groundbreakers exhibition at Cambridge's Fitzwilliam Museum. The exhibition opens on Tuesday. The 1929 report from the school which Turing attended from the age of 13 is on show alongside other personal items.
Human-in-the-loop Artificial Intelligence
Little by little, newspapers are revealing the bright future that Artificial Intelligence (AI) is building. Intelligent machines will help everywhere. However, this bright future has a dark side: a dramatic job market contraction before its unpredictable transformation. Hence, in a near future, large numbers of job seekers will need financial support while catching up with these novel unpredictable jobs. This possible job market crisis has an antidote inside. In fact, the rise of AI is sustained by the biggest knowledge theft of the recent years. Learning AI machines are extracting knowledge from unaware skilled or unskilled workers by analyzing their interactions. By passionately doing their jobs, these workers are digging their own graves. In this paper, we propose Human-in-the-loop Artificial Intelligence (HIT-AI) as a fairer paradigm for Artificial Intelligence systems. HIT-AI will reward aware and unaware knowledge producers with a different scheme: decisions of AI systems generating revenues will repay the legitimate owners of the knowledge used for taking those decisions. As modern Robin Hoods, HIT-AI researchers should fight for a fairer Artificial Intelligence that gives back what it steals.
Improving Efficiency in Convolutional Neural Network with Multilinear Filters
Tran, Dat Thanh, Iosifidis, Alexandros, Gabbouj, Moncef
The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require billions of floating point operations. Several works have been developed to compress a pre-trained deep network to reduce memory footprint and, possibly, computation. Instead of compressing a pre-trained network, in this work, we propose a generic neural network layer structure employing multilinear projection as the primary feature extractor. The proposed architecture requires several times less memory as compared to the traditional Convolutional Neural Networks (CNN), while inherits the similar design principles of a CNN. In addition, the proposed architecture is equipped with two computation schemes that enable computation reduction or scalability. Experimental results show the effectiveness of our compact projection that outperforms traditional CNN, while requiring far fewer parameters.
Interactive Visual Data Exploration with Subjective Feedback: An Information-Theoretic Approach
Puolamäki, Kai, Oikarinen, Emilia, Kang, Bo, Lijffijt, Jefrey, De Bie, Tijl
Visual exploration of high-dimensional real-valued datasets is a fundamental task in exploratory data analysis (EDA). Existing methods use predefined criteria to choose the representation of data. There is a lack of methods that (i) elicit from the user what she has learned from the data and (ii) show patterns that she does not know yet. We construct a theoretical model where identified patterns can be input as knowledge to the system. The knowledge syntax here is intuitive, such as "this set of points forms a cluster", and requires no knowledge of maths. This background knowledge is used to find a Maximum Entropy distribution of the data, after which the system provides the user data projections in which the data and the Maximum Entropy distribution differ the most, hence showing the user aspects of the data that are maximally informative given the user's current knowledge. We provide an open source EDA system with tailored interactive visualizations to demonstrate these concepts. We study the performance of the system and present use cases on both synthetic and real data. We find that the model and the prototype system allow the user to learn information efficiently from various data sources and the system works sufficiently fast in practice. We conclude that the information theoretic approach to exploratory data analysis where patterns observed by a user are formalized as constraints provides a principled, intuitive, and efficient basis for constructing an EDA system.
SMSSVD - SubMatrix Selection Singular Value Decomposition
Henningsson, Rasmus, Fontes, Magnus
High throughput biomedical measurements normally capture multiple overlaid biologically relevant signals and often also signals representing different types of technical artefacts like e.g. batch effects. Signal identification and decomposition are accordingly main objectives in statistical biomedical modeling and data analysis. Existing methods, aimed at signal reconstruction and deconvolution, in general, are either supervised, contain parameters that need to be estimated or present other types of ad hoc features. We here introduce SubMatrix Selection SingularValue Decomposition (SMSSVD), a parameter-free unsupervised signal decomposition and dimension reduction method, designed to reduce noise, adaptively for each low-rank-signal in a given data matrix, and represent the signals in the data in a way that enable unbiased exploratory analysis and reconstruction of multiple overlaid signals, including identifying groups of variables that drive different signals. The Submatrix Selection Singular Value Decomposition (SMSSVD) method produces a denoised signal decomposition from a given data matrix. The SMSSVD method guarantees orthogonality between signal components in a straightforward manner and it is designed to make automation possible. We illustrate SMSSVD by applying it to several real and synthetic datasets and compare its performance to golden standard methods like PCA (Principal Component Analysis) and SPC (Sparse Principal Components, using Lasso constraints). The SMSSVD is computationally efficient and despite being a parameter-free method, in general, outperforms existing statistical learning methods. A Julia implementation of SMSSVD is openly available on GitHub (https://github.com/rasmushenningsson/SMSSVD.jl).