nengo
Probabilistic Modeling of Spiking Neural Networks with Contract-Based Verification
Yao, Zhen, De Maria, Elisabetta, De Simone, Robert
Spiking Neural Networks (SNN) are models for "realistic" neuronal computation, which makes them somehow different in scope from "ordinary" deep-learning models widely used in AI platforms nowadays. SNNs focus on timed latency (and possibly probability) of neuronal reactive activation/response, more than numerical computation of filters. So, an SNN model must provide modeling constructs for elementary neural bundles and then for synaptic connections to assemble them into compound data flow network patterns. These elements are to be parametric patterns, with latency and probability values instantiated on particular instances (while supposedly constant "at runtime"). Designers could also use different values to represent "tired" neurons, or ones impaired by external drugs, for instance. One important challenge in such modeling is to study how compound models could meet global reaction requirements (in stochastic timing challenges), provided similar provisions on individual neural bundles. A temporal language of logic to express such assume/guarantee contracts is thus needed. This may lead to formal verification on medium-sized models and testing observations on large ones. In the current article, we make preliminary progress at providing a simple model framework to express both elementary SNN neural bundles and their connecting constructs, which translates readily into both a model-checker and a simulator (both already existing and robust) to conduct experiments.
Nengo: A New Neural Network Building and Deployment Tool
Nengo is a useful tool for building and testing neural networks, besides deep learning, it helps in working memory, path integration, etc. It also contains Add-ons and Simulators but the two main important Add-ons are KerasSpiking and PyTorchSpiking for spiking neural networks in their respective frameworks. To install the Nengo use the pip command in the anaconda prompt. To use the interactive Nengo GUI, we need to install the nengo GUI. After installing GUI, we can use the nengo command to open the interactive GUI of nengo.
Neuromorphic Processing and Sensing: Evolutionary Progression of AI to Spiking
Reiter, Philippe, Jose, Geet Rose, Bizmpikis, Spyridon, Cîrjilă, Ionela-Ancuţa
The increasing rise in machine learning and deep learning applications is requiring ever more computational resources to successfully meet the growing demands of an always-connected, automated world. Neuromorphic technologies based on Spiking Neural Network algorithms hold the promise to implement advanced artificial intelligence using a fraction of the computations and power requirements by modeling the functioning, and spiking, of the human brain. With the proliferation of tools and platforms aiding data scientists and machine learning engineers to develop the latest innovations in artificial and deep neural networks, a transition to a new paradigm will require building from the current well-established foundations. This paper explains the theoretical workings of neuromorphic technologies based on spikes, and overviews the state-of-art in hardware processors, software platforms and neuromorphic sensing devices. A progression path is paved for current machine learning specialists to update their skillset, as well as classification or predictive models from the current generation of deep neural networks to SNNs. This can be achieved by leveraging existing, specialized hardware in the form of SpiNNaker and the Nengo migration toolkit. First-hand, experimental results of converting a VGG-16 neural network to an SNN are shared. A forward gaze into industrial, medical and commercial applications that can readily benefit from SNNs wraps up this investigation into the neuromorphic computing future.
Dynamic Action Selection in OpenAI Using Spiking Neural Networks
Peters, Chad (Carleton University) | Stewart, Terrence C. (University of Waterloo) | West, Robert L. (Carleton University) | Esfandiari, Babak
Modelling biologically-plausible neural structures for intelligent agents presents a unique challenge when operating in real-time domains. Neurons in our brains have different response properties, firing rates, and propagation lengths, creating noise that cannot be reliably decoded. This research explores the strengths and limitations of LIF spiking neuron ensembles for application in OpenAI virtual environments. Topics discussed include how we represent arbitrary environmental signals from multiple senses, choosing between equally viable actions in a given scenario, and how one can create a generic model that can learn and operate in a verity of situations.
The future of AI is neuromorphic. Meet the scientists building digital 'brains' for your phone
AI services like Apple's Siri and others operate by sending your queries to faraway data centers, which send back responses. The reason they rely on cloud-based computing is that today's electronics don't come with enough computing power to run the processing-heavy algorithms needed for machine learning. The typical CPUs most smartphones use could never handle a system like Siri on the device. But Dr. Chris Eliasmith, a theoretical neuroscientist and co-CEO of Canadian AI startup Applied Brain Research, is confident that a new type of chip is about to change that. "Many have suggested Moore's law is ending and that means we won't get'more compute' cheaper using the same methods," Eliasmith says.