Industry
Event-Driven Simulation of Networks of Spiking Neurons
A fast event-driven software simulator has been developed for simulating largenetworks of spiking neurons and synapses. The primitive network elements are designed to exhibit biologically realistic behaviors, such as spiking, refractoriness, adaptation, axonal delays, summation of post-synaptic current pulses, and tonic current inputs.The efficient event-driven representation allows large networks to be simulated in a fraction of the time that would be required for a full compartmental-model simulation. Corresponding analogCMOS VLSI circuit primitives have been designed and characterized, so that large-scale circuits may be simulated prior to fabrication. 1 Introduction Artificial neural networks typically use an abstraction of real neuron behaviour, in which the continuously varying mean firing rate of the neuron is presumed to carry the information about the neuron's time-varying state of excitation [1]. This useful simplification allows the neuron's state to be represented as a time-varying continuous-amplitude quantity. However, spike timing is known to be important in many biological systems.
An Analog VLSI Saccadic Eye Movement System
Horiuchi, Timothy K., Bishofberger, Brooks, Koch, Christof
In an effort to understand saccadic eye movements and their relation tovisual attention and other forms of eye movements, we - in collaboration with a number of other laboratories - are carrying outa large-scale effort to design and build a complete primate oculomotor system using analog CMOS VLSI technology. Using this technology, a low power, compact, multi-chip system has been built which works in real-time using real-world visual inputs. We describe in this paper the performance of an early version of such a system including a 1-D array of photoreceptors mimicking the retina, a circuit computing the mean location of activity representing thesuperior colliculus, a saccadic burst generator, and a one degree-of-freedom rotational platform which models the dynamic properties of the primate oculomotor plant. 1 Introduction When we look around our environment, we move our eyes to center and stabilize objects of interest onto our fovea. In order to achieve this, our eyes move in quick jumps with short pauses in between. These quick jumps (up to 750 deg/sec in humans) areknown as saccades and are seen in both exploratory eye movements and as reflexive eye movements in response to sudden visual, auditory, or somatosensory stimuli.Since the intent of the saccade is to bring new objects of interest onto the fovea, it can be considered a primitive attentional mechanism.
Connectionism for Music and Audition
In recent years, NIPS has heard neural networks generate tunes and harmonize chorales. With a large amount of music becoming available in computer readable form, real data can be used to train connectionist models. At the beginning of this workshop, Andreas Weigend focused on architectures to capture structure on multiple time scales.
Observability of Neural Network Behavior
Garzon, Max, Botelho, Fernanda
We prove that except possibly for small exceptional sets, discretetime analogneural nets are globally observable, i.e. all their corrupted pseudo-orbitson computer simulations actually reflect the true dynamical behavior of the network. Locally finite discrete (boolean) neural networks are observable without exception.
Correlation Functions in a Large Stochastic Neural Network
Ginzburg, Iris, Sompolinsky, Haim
In many cases the crosscorrelations betweenthe activities of cortical neurons are approximately symmetric about zero time delay. These have been taken as an indication of the presence of "functional connectivity" between the correlated neurons (Fetz, Toyama and Smith 1991, Abeles 1991). However, a quantitative comparison between the observed cross-correlations and those expected to exist between neurons that are part of a large assembly of interacting population has been lacking. Most of the theoretical studies of recurrent neural network models consider only time averaged firing rates, which are usually given as solutions of mean-field equations. They do not account for the fluctuations about these averages, the study of which requires going beyond the mean-field approximations. In this work we perform a theoretical study of the fluctuations in the neuronal activities and their correlations, in a large stochastic network of excitatory and inhibitory neurons. Depending on the model parameters, this system can exhibit coherent undamped oscillations. Here we focus on parameter regimes where the system is in a statistically stationary state, which is more appropriate for modeling non oscillatory neuronal activity in cortex. Our results for the magnitudes and the time-dependence of the correlation functions can provide a basis for comparison with physiological data on neuronal correlation functions.
Segmental Neural Net Optimization for Continuous Speech Recognition
Zhao, Ying, Schwartz, Richard, Makhoul, John, Zavaliagkos, George
Previously, we had developed the concept of a Segmental Neural Net (SNN) for phonetic modeling in continuous speech recognition (CSR). This kind of neural networktechnology advanced the state-of-the-art of large-vocabulary CSR, which employs Hidden Marlcov Models (HMM), for the ARPA 1oo0-word Resource Managementcorpus. More Recently, we started porting the neural net system to a larger, more challenging corpus - the ARPA 20,Ooo-word Wall Street Journal (WSJ) corpus. During the porting, we explored the following research directions to refine the system: i) training context-dependent models with a regularization method;ii) training SNN with projection pursuit; and ii) combining different models into a hybrid system. When tested on both a development set and an independent test set, the resulting neural net system alone yielded a perfonnance atthe level of the HMM system, and the hybrid SNN/HMM system achieved a consistent 10-15% word error reduction over the HMM system. This paper describes our hybrid system, with emphasis on the optimization methods employed.
The 1994 Florida AI Research Symposium
The atmosphere was definitely international--270 participants from around the world. It is frustrating that no brain, let be important in AI. Included among the meeting's were frustrated by the desire However, without these frustrations, in AI, cognitive science, and discussed ways in which AI could be we would, of course, know that allied disciplines to discuss timely topics, seen as an enabling technology with there was no need for such meetings. As it was, everyone came away with a development efforts in areas spanning FLAIRS-94 was notable for the mix stack of business cards and some the entire AI field. FLAIRS-94 was of industry, government, and academic things to do right away.
Applied AI News
MT Telecom, a Dutch telecommunications utility, has installed expert BNR Europe (Harlow, England), the instrument aboard the satellite. Pending system-based help desk systems to R&D subsidiary of telecommunications NASA approval, EUVE will be the centralize its 23 networked local data equipment supplier Northern first orbiting astrophysics mission to Telecom, is using virtual reality technology replace humans with AI technology. This installation proved to be a critical planning. The VR system allows Re:Member Data Services (Memphis, factor in helping the company BNR's engineers to visualize complex Tenn.), a data processor for obtain the IS0 9000 Total Quality installations and how they will work, credit union software services, has System Standard certification, a greatly saving time and effort compared automated all company service and requirement for those organizations to the traditional CAD system. Continental Bank (Chicago, Ill.) has expert system tracks all requests developed a client/server-based intelligent called in by users, and all requests Lockheed Missiles ST Space (Palo application to improve the can be accessed by anyone at the Alto, Calif.) has developed ASAP quality of its customer service.
Research Issues in Qualitative and Abstract Probability
To assess the state of the art and identify issues requiring further investigation, a workshop on qualitative and abstract probability was held during the third week of November 1993. This workshop brought together a mix of active researchers from academia, industry, and government interested in the practical and theoretical impact of these abstractions on techniques, methods, and tools for solving complex AI tasks. The result was a set of specific recommendations on the most promising and important avenues for future research.