Goto

Collaborating Authors

 Genre


Distributed Estimation of the Operating State of a Single-Bus DC MicroGrid without an External Communication Interface

arXiv.org Machine Learning

We propose a decentralized Maximum Likelihood solution for estimating the stochastic renewable power generation and demand in single bus Direct Current (DC) MicroGrids (MGs), with high penetration of droop controlled power electronic converters. The solution relies on the fact that the primary control parameters are set in accordance with the local power generation status of the generators. Therefore, the steady state voltage is inherently dependent on the generation capacities and the load, through a non-linear parametric model, which can be estimated. To have a well conditioned estimation problem, our solution avoids the use of an external communication interface and utilizes controlled voltage disturbances to perform distributed training. Using this tool, we develop an efficient, decentralized Maximum Likelihood Estimator (MLE) and formulate the sufficient condition for the existence of the globally optimal solution. The numerical results illustrate the promising performance of our MLE algorithm.


False Discoveries Occur Early on the Lasso Path

arXiv.org Machine Learning

In regression settings where explanatory variables have very low correlations and there are relatively few effects, each of large magnitude, we expect the Lasso to find the important variables with few errors, if any. This paper shows that in a regime of linear sparsity---meaning that the fraction of variables with a non-vanishing effect tends to a constant, however small---this cannot really be the case, even when the design variables are stochastically independent. We demonstrate that true features and null features are always interspersed on the Lasso path, and that this phenomenon occurs no matter how strong the effect sizes are. We derive a sharp asymptotic trade-off between false and true positive rates or, equivalently, between measures of type I and type II errors along the Lasso path. This trade-off states that if we ever want to achieve a type II error (false negative rate) under a critical value, then anywhere on the Lasso path the type I error (false positive rate) will need to exceed a given threshold so that we can never have both errors at a low level at the same time. Our analysis uses tools from approximate message passing (AMP) theory as well as novel elements to deal with a possibly adaptive selection of the Lasso regularizing parameter.


Relativistic Monte Carlo

arXiv.org Machine Learning

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time discretizations and performs poorly if there is a mismatch between the spatial geometry of the target distribution and the scales of the momentum distribution. In particular the mass matrix of HMC is hard to tune well. In order to alleviate these problems we propose relativistic Hamiltonian Monte Carlo, a version of HMC based on relativistic dynamics that introduce a maximum velocity on particles. We also derive stochastic gradient versions of the algorithm and show that the resulting algorithms bear interesting relationships to gradient clipping, RMSprop, Adagrad and Adam, popular optimisation methods in deep learning. Based on this, we develop relativistic stochastic gradient descent by taking the zero-temperature limit of relativistic stochastic gradient Hamiltonian Monte Carlo. In experiments we show that the relativistic algorithms perform better than classical Newtonian variants and Adam.


Clustering Time Series and the Surprising Robustness of HMMs

arXiv.org Machine Learning

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the distributions of the sources. A standard approach to this problem is to model the data as a hidden Markov model (HMM). However, since the data often lacks the Markov or the stationarity properties of an HMM, one can ask whether this approach is still suitable or perhaps another approach is required. In this paper we show that a maximum likelihood HMM estimator can be used to approximate the source distributions in a much larger class of models than HMMs. Specifically, we propose a natural and fairly general non-stationary model of the data, where the only restriction is that the sources do not change too often. Our main result shows that for this model, a maximum-likelihood HMM estimator produces the correct second moment of the data, and the results can be extended to higher moments.


The LICORS Cabinet: Nonparametric Algorithms for Spatio-temporal Prediction

arXiv.org Machine Learning

Spatio-temporal data is intrinsically high dimensional, so unsupervised modeling is only feasible if we can exploit structure in the process. When the dynamics are local in both space and time, this structure can be exploited by splitting the global field into many lower-dimensional "light cones". We review light cone decompositions for predictive state reconstruction, introducing three simple light cone algorithms. These methods allow for tractable inference of spatio-temporal data, such as full-frame video. The algorithms make few assumptions on the underlying process yet have good predictive performance and can provide distributions over spatio-temporal data, enabling sophisticated probabilistic inference.


The multi-vehicle covering tour problem: building routes for urban patrolling

arXiv.org Artificial Intelligence

In this paper we study a particular aspect of the urban community policing: routine patrol route planning. We seek routes that guarantee visibility, as this has a sizable impact on the community perceived safety, allowing quick emergency responses and providing surveillance of selected sites (e.g., hospitals, schools). The planning is restricted to the availability of vehicles and strives to achieve balanced routes. We study an adaptation of the model for the multi-vehicle covering tour problem, in which a set of locations must be visited, whereas another subset must be close enough to the planned routes. It constitutes an NP-complete integer programming problem. Suboptimal solutions are obtained with several heuristics, some adapted from the literature and others developed by us. We solve some adapted instances from TSPLIB and an instance with real data, the former being compared with results from literature, and latter being compared with empirical data.


Artificial Intelligence, Machine Learning, and Cognitive Computing: Market and Outlook for Communications, Applications, Content and Commerce 2016 - 2021

#artificialintelligence

Overview: Artificial Intelligence is a technology that uses machine intelligence and human like thinking ability to process historical, and increasingly, real-time data to make predictions, recommendations, and decisions. AI is not a single technology but a convergence of various technologies, statistical models, algorithms, and approaches. Machine Learning is a subfield of computer science that evolved from the study of pattern recognition and computational learning theory in AI. Cognitive Computing involves self-learning systems that use data mining, pattern recognition and natural language processing to mimic the way the human brain works. AI is increasingly integrated in many areas including Internet search, entertainment, commerce applications, content optimization, and robotics.


ITU partners with IBM Watson's XPRIZE to promote AI innovation

#artificialintelligence

Data volumes are soaring to previously unimaginable heights. More data has been created in the past two years than in the entire history of humanity. It is predicted that, by 2020, each person on the planet will account for the creation of an average of 1.7 megabytes of new data every second. Scalable AI solutions could help address humanity's biggest challenges. Drawing meaningful insight from such vast amounts data is beyond our capabilities as humans, but perhaps not those of machines.


researchers_discover_machines_can_learn_by_simply_observing-179439

#artificialintelligence

It is now possible for machines to learn how natural or artificial systems work by simply observing them, without being told what to look for, according to researchers at the University of Sheffield. He added: "Unlike in the original Turing test, however, our interrogators are not human but rather computer programs that learn by themselves. They would not simply copy the observed behaviour, but rather reveal what makes human players distinctive from the rest." So far, Dr Gross and his team have tested Turing Learning in robot swarms but the next step is to reveal the workings of some animal collectives such as schools of fish or colonies of bees.


Machine Learning Could Help The Diagnosis of Drug-Resistant Epilepsy

#artificialintelligence

'Machine learning', a type of computer modelling, can detect areas of brain damage (lesions) associated with drug-resistant epilepsy. This is according to a new study published in the scientific journal PLOS One. During the study, researchers led by Dr Carole Lartizien, from the University of Lyon, developed a complex system that is able learn features associated with healthy brain MRI scans. It can then be used to assess other MRI scans for abnormalities (i.e. The scientists focused on two parameters, detectable on MRI images, that are associated with lesions linked to epilepsy.