Goto

Collaborating Authors

 Overview


Correlated Random Measures

arXiv.org Machine Learning

We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based construction in which the atom weights are independent. Completely random measures imply strong independence assumptions in the corresponding hierarchical model, and these assumptions are often misplaced in real-world settings. Correlated random measures address this limitation. They model correlation within the measure by using a Gaussian process in concert with the Poisson process. With correlated random measures, for example, we can develop a latent feature model for which we can infer both the properties of the latent features and their dependency pattern. We develop several other examples as well. We study a correlated random measure model of pairwise count data. We derive an efficient variational inference algorithm and show improved predictive performance on large data sets of documents, web clicks, and electronic health records.


FETLT 2016 - Future and Emerging Trends in Language Technologies

#artificialintelligence

Language Technologies must be considered an area of particular relevance both at the academic and industrial levels. In recent years, several programs have been designed to promote research and development, entrepreneurship and innovation that have highlighted the key role of these technologies for progress and society. At the European level, we have witnessed a strong funding action in the field from the 7th Framework Programme to the H2020 that have resulted in the creation of what has been called the European Multilingual Digital Single Market. In Spain, for example, the government presented a Plan to Promote Language Technologies with an estimated investment of over 70 million euros. In 2015, a group of professors and researchers at the University of Seville faced the challenge to convene a workshop where experts from different countries could meet to analyze emerging trends in this field so that they could also envision the pace for the future.


Looking to Build AI Credibility, Fujitsu Explores Novel Technologies

#artificialintelligence

IT giant Fujitsu has been developing a series of in-house technologies aimed at the burgeoning market of artificial intelligence and machine learning. Although the company has made less fanfare of its ambitions in this regard than companies like IBM, Google and Microsoft, the Japanese multinational seems intent on expanding its datacenter business into this new high-value segment. The step-up in AI focus has been especially noticeable over the past several months, where hardly week went by without an announcement of a new technology or use case. In fact, Fujitsu has issued no less than 15 press releases on AI or machine learning since the beginning of 2016. Most are the result of technologies developed at Fujitsu Laboratories.


The Administration's Report on the Future of Artificial Intelligence

#artificialintelligence

Under President Obama's leadership, America continues to be the world's most innovative country, with the greatest potential to develop the industries of the future and harness science and technology to help address important challenges. Over the past 8 years, President Obama has relentlessly focused on building U.S. capacity in science and technology. This Thursday, President Obama will host the White House Frontiers Conference in Pittsburgh to imagine the Nation and the world in 50 years and beyond, and to explore America's potential to advance towards the frontiers that will make the world healthier, more prosperous, more equitable, and more secure. Today, to ready the United States for a future in which Artificial Intelligence (AI) plays a growing role, the White House is releasing a report on future directions and considerations for AI called Preparing for the Future of Artificial Intelligence. This report surveys the current state of AI, its existing and potential applications, and the questions that progress in AI raise for society and public policy.


A primer on universal function approximation with deep learning (in Torch and R)

@machinelearnbot

Arthur C. Clarke famously stated that "any sufficiently advanced technology is indistinguishable from magic." No current technology embodies this statement more than neural networks and deep learning. And like any good magic it not only dazzles and inspires but also puts fear into people's hearts. One known property of artificial neural networks (ANNs) is that they are universal function approximators. This means that any mathematical function can be represented by a neural network.


Building Machines That Learn and Think Like People

arXiv.org Artificial Intelligence

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn, and how they learn it. Specifically, we argue that these machines should (a) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (b) ground learning in intuitive theories of physics and psychology, to support and enrich the knowledge that is learned; and (c) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes towards these goals that can combine the strengths of recent neural network advances with more structured cognitive models.


Artificial Intelligence, Deep Learning, and Neural Networks, Explained

#artificialintelligence

Artificial intelligence (AI), deep learning, and neural networks represent incredibly exciting and powerful machine learning-based techniques used to solve many real-world problems. For a primer on machine learning, you may want to read this five-part series that I wrote. While human-like deductive reasoning, inference, and decision-making by a computer is still a long time away, there have been remarkable gains in the application of AI techniques and associated algorithms. The concepts discussed here are extremely technical, complex, and based on mathematics, statistics, probability theory, physics, signal processing, machine learning, computer science, psychology, linguistics, and neuroscience. That said, this article is not meant to provide such a technical treatment, but rather to explain these concepts at a level that can be understood by most non-practitioners, and can also serve as a reference or review for technical folks as well.


Solving Large-scale Systems of Random Quadratic Equations via Stochastic Truncated Amplitude Flow

arXiv.org Machine Learning

A novel approach termed \emph{stochastic truncated amplitude flow} (STAF) is developed to reconstruct an unknown $n$-dimensional real-/complex-valued signal $\bm{x}$ from $m$ `phaseless' quadratic equations of the form $\psi_i=|\langle\bm{a}_i,\bm{x}\rangle|$. This problem, also known as phase retrieval from magnitude-only information, is \emph{NP-hard} in general. Adopting an amplitude-based nonconvex formulation, STAF leads to an iterative solver comprising two stages: s1) Orthogonality-promoting initialization through a stochastic variance reduced gradient algorithm; and, s2) A series of iterative refinements of the initialization using stochastic truncated gradient iterations. Both stages involve a single equation per iteration, thus rendering STAF a simple, scalable, and fast approach amenable to large-scale implementations that is useful when $n$ is large. When $\{\bm{a}_i\}_{i=1}^m$ are independent Gaussian, STAF provably recovers exactly any $\bm{x}\in\mathbb{R}^n$ exponentially fast based on order of $n$ quadratic equations. STAF is also robust in the presence of additive noise of bounded support. Simulated tests involving real Gaussian $\{\bm{a}_i\}$ vectors demonstrate that STAF empirically reconstructs any $\bm{x}\in\mathbb{R}^n$ exactly from about $2.3n$ magnitude-only measurements, outperforming state-of-the-art approaches and narrowing the gap from the information-theoretic number of equations $m=2n-1$. Extensive experiments using synthetic data and real images corroborate markedly improved performance of STAF over existing alternatives.


5 Free Statistics eBooks You Need to Read This Autumn

#artificialintelligence

I hope you enjoy them, and it would be great if you would leave brief reviews of these books in the comments below – I'm sure all the authors would appreciate your comments and shares. About the Author Lee Baker is an award-winning software creator with a passion for turning data into a story. A proud Yorkshireman, he now lives by the sparkling shores of the East Coast of Scotland. Physicist, statistician and programmer, child of the flower-power psychedelic '60s, it's amazing he turned out so normal! Turning his back on a promising academic career to do something more satisfying, as the CEO and co-founder of Chi-Squared Innovations he now works double the hours for half the pay and 10 times the stress - but 100 times the fun! He also wanted to be rich, famous and good looking.


Democratizing AI: Doubling Down on Clarifai

#artificialintelligence

Machine learning, AI, Conv Nets, Deep Learning, and Neural Nets … all rapidly maturing Artificial Intelligence technologies that have simultaneously become household jargon in the Valley. Tesla's self driving car, Amazon Alexa, Google Search, Facebook tag recommendations, Microsoft Cortana, and Apple Siri … all novel products leveraging the above mentioned AI technologies, developed by large tech mainstays, and increasingly popular nation wide. Technocrati cocktail banter is developed and largely kept in-house by large technology incumbents to develop new products and disrupt adjacent industries. That said, historically a rapid rise and maturation of a new technology germinates within the the confines of a select few labs, institutions, social classes, and corporations before hitting a critical juncture when, via technological or economic means, it rapidly democratizes and is made available to everyone. Clarifai's growing product suite around developer centric AI tools are leading exactly that charge: democratizing the Artificial Intelligence revolution.