Goto

Collaborating Authors

 Europe


On the Computational Power of Noisy Spiking Neurons

Neural Information Processing Systems

It has remained unknown whether one can in principle carry out reliable digital computations with networks of biologically realistic models for neurons. This article presents rigorous constructions for simulating in real-time arbitrary given boolean circuits and finite automatawith arbitrarily high reliability by networks of noisy spiking neurons. In addition we show that with the help of "shunting inhibition" even networks of very unreliable spiking neurons can simulate in real-time any McCulloch-Pitts neuron (or "threshold gate"), and therefore any multilayer perceptron (or "threshold circuit") in a reliable manner. These constructions provide a possible explanation forthe fact that biological neural systems can carry out quite complex computations within 100 msec. It turns out that the assumption that these constructions require about the shape of the EPSP's and the behaviour of the noise are surprisingly weak. 1 Introduction


Learning with ensembles: How overfitting can be useful

Neural Information Processing Systems

AndersKrogh'" NORDITA, Blegdamsvej 17 2100 Copenhagen, Denmark kroghGsanger.ac.uk Abstract We study the characteristics of learning with ensembles. Solving exactly the simple model of an ensemble of linear students, we find surprisingly rich behaviour. For learning in large ensembles, it is advantageous to use under-regularized students, which actually over-fitthe training data. Globally optimal performance can be obtained by choosing the training set sizes of the students appropriately. Forsmaller ensembles, optimization of the ensemble weights can yield significant improvements in ensemble generalization performance,in particular if the individual students are subject to noise in the training process. Choosing students with a wide range of regularization parameters makes this improvement robust against changes in the unknown level of noise in the training data. 1 INTRODUCTION An ensemble is a collection of a (finite) number of neural networks or other types of predictors that are trained for the same task.


Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway

Neural Information Processing Systems

Binaural coincidence detection is essential for the localization of external sounds and requires auditory signal processing with high temporal precision. We present an integrate-and-fire model of spike processing in the auditory pathway of the barn owl. It is shown that a temporal precision in the microsecond range can be achieved with neuronal time constants which are at least one magnitude longer. An important feature of our model is an unsupervised Hebbian learning rule which leads to a temporal fine tuning of the neuronal connections.


Using Artificial Neural Networks to Predict the Quality and Performance of Oil-Field Cements

AI Magazine

Inherent batch-to-batch variability, aging, and contamination are major factors contributing to variability in oil-field cement-slurry performance. Of particular concern are problems encountered when a slurry is formulated with one cement sample and used with a batch having different properties. Such variability imposes a heavy burden on performance testing and is often a major factor in operational failure. We describe methods that allow the identification, characterization, and prediction of the variability of oil-field cements. Our approach involves predicting cement compositions, particle-size distributions, and thickening-time curves from the diffuse reflectance infrared Fourier transform spectrum of neat cement powders. Predictions make use of artificial neural networks. Slurry formulation thickening times can be predicted with uncertainties of less than 10 percent. Composition and particle-size distributions can be predicted with uncertainties a little greater than measurement error, but general trends and differences between cements can be determined reliably. Our research shows that many key cement properties are captured within the Fourier transform infrared spectra of cement powders and can be predicted from these spectra using suitable neural network techniques. Several case studies are given to emphasize the use of these techniques, which provide the basis for a valuable quality control tool now finding commercial use in the oil field.



Diagnosing Delivery Problems in the White House Information-Distribution System

AI Magazine

As part of a collaboration with the White House Office of Media Affairs, members of the Artificial Intelligence Laboratory at the Massachusetts Institute of Technology designed a system, called COMLINK, that distributes a daily stream of documents released by the Office of Media Affairs. Approximately 4,000 direct subscribers receive information from this service, but more than 100,000 people receive the information through redistribution channels. The information is distributed through e-mail and the World Wide Web. In such a large-scale distribution scheme, there is a constant problem of subscriptions becoming invalid because the user's e-mail account has terminated. These invalid subscriptions cause a backwash of hundreds of bounced-mail messages each day that must be processed by the operators of the COMLINK system. To manage this annoying but necessary task, an expert system named BMES was developed to diagnose the failures of information delivery.


Developing and Deploying Knowledge on a Global Scale

AI Magazine

Reuters is a worldwide company focused on supplying financial and news information to its more than 40,000 subscribers around the world. To enhance the quality and consistency of its customer- support organization, Reuters embarked on a global knowledge development and reuse project. The resulting system is in operational use in North America, Europe, and Asia. The system supports 38 Reuter products worldwide. This article presents a case study of Reuter experience in putting a global knowledge organization in place, building knowledge bases at multiple distributed sites, deploying these knowledge bases in multiple sites around the world, and maintaining and enhancing knowledge bases within a global organizational framework. This project is the first to address issues in multicountry knowledge development and maintenance and multicountry knowledge deployment. These issues are critical for global companies to understand, address, and resolve to effectively gain the benefits of global knowledge systems.


Intelligent Retail Logistics Scheduling

AI Magazine

The supply-chain integrated ordering network (SCION) depot-bookings system automates the planning and scheduling of perishable and nonperishable commodities and the vehicles that carry them into J. Sainsbury depots. This initiative is strategic, enabling the business to make the key move from weekly to daily ordering. The system is mission critical, managing the inward flow of commodities from suppliers into J. Sainsbury's depots. The system leverages AI techniques to provide a business solution that meets challenging functional and performance needs. The SCION depot-bookings system is operational, providing schedules for 22 depots across the United Kingdom.


Exploiting Causal Independence in Bayesian Network Inference

Journal of Artificial Intelligence Research

A new method is proposed for exploiting causal independencies in exact Bayesian network inference. A Bayesian network can be viewed as representing a factorization of a joint probability into the multiplication of a set of conditional probabilities. We present a notion of causal independence that enables one to further factorize the conditional probabilities into a combination of even smaller factors and consequently obtain a finer-grain factorization of the joint probability. The new formulation of causal independence lets us specify the conditional probability of a variable given its parents in terms of an associative and commutative operator, such as ``or'', ``sum'' or ``max'', on the contribution of each parent. We start with a simple algorithm VE for Bayesian network inference that, given evidence and a query variable, uses the factorization to find the posterior distribution of the query. We show how this algorithm can be extended to exploit causal independence. Empirical studies, based on the CPCS networks for medical diagnosis, show that this method is more efficient than previous methods and allows for inference in larger networks than previous algorithms.


Learning First-Order Definitions of Functions

Journal of Artificial Intelligence Research

First-order learning involves finding a clause-form definition of a relation from examples of the relation and relevant background information. In this paper, a particular first-order learning system is modified to customize it for finding definitions of functional relations. This restriction leads to faster learning times and, in some cases, to definitions that have higher predictive accuracy. Other first-order learning systems might benefit from similar specialization.