Chen, Jiechen
Neuromorphic Wireless Split Computing with Multi-Level Spikes
Wu, Dengyu, Chen, Jiechen, Rajendran, Bipin, Poor, H. Vincent, Simeone, Osvaldo
Inspired by biological processes, neuromorphic computing utilizes spiking neural networks (SNNs) to perform inference tasks, offering significant efficiency gains for workloads involving sequential data. Recent advances in hardware and software have demonstrated that embedding a few bits of payload in each spike exchanged between the spiking neurons can further enhance inference accuracy. In a split computing architecture, where the SNN is divided across two separate devices, the device storing the first layers must share information about the spikes generated by the local output neurons with the other device. Consequently, the advantages of multi-level spikes must be balanced against the challenges of transmitting additional bits between the two devices. For this system, we present the design of digital and analog modulation schemes optimized for an orthogonal frequency division multiplexing (OFDM) radio interface. Simulation and experimental results using software-defined radios provide insights into the performance gains of multi-level SNN models and the optimal payload size as a function of the quality of the connection between a transmitter and receiver. D. Wu and B. Rajendran are with the King's Laboratory for Intelligent Computing (KLIC) lab within the Centre for Intelligent Information Processing Systems (CIIPS) at the Department of Engineering, King's College London, London, WC2R 2LS, UK (email:{dengyu.wu, J. Chen and O. Simeone are with the King's Communications, Learning and Information Processing (KCLIP) lab within the CIIPS at the Department of Engineering, King's College London, London, WC2R 2LS, UK (email:{jiechen.chen,
SpikeCP: Delay-Adaptive Reliable Spiking Neural Networks via Conformal Prediction
Chen, Jiechen, Park, Sangwoo, Simeone, Osvaldo
Spiking neural networks (SNNs) process time-series data via internal event-driven neural dynamics whose energy consumption depends on the number of spikes exchanged between neurons over the course of the input presentation. In typical implementations of an SNN classifier, decisions are produced after the entire input sequence has been processed, resulting in latency and energy consumption levels that are fairly uniform across inputs. Recently introduced delay-adaptive SNNs tailor the inference latency -- and, with it, the energy consumption -- to the difficulty of each example, by producing an early decision when the SNN model is sufficiently ``confident''. In this paper, we start by observing that, as an SNN processes input samples, its classification decisions tend to be first under-confident and then over-confident with respect to the decision's ground-truth, unknown, test accuracy. This makes it difficult to determine a stopping time that ensures a desired level of accuracy. To address this problem, we introduce a novel delay-adaptive SNN-based inference methodology that, wrapping around any pre-trained SNN classifier, provides guaranteed reliability for the decisions produced at input-dependent stopping times. The approach entails minimal added complexity as compared to the underlying SNN, requiring only thresholding and counting operations at run time, and it leverages tools from conformal prediction (CP).
Neuromorphic Wireless Cognition: Event-Driven Semantic Communications for Remote Inference
Chen, Jiechen, Skatchkovsky, Nicolas, Simeone, Osvaldo
Neuromorphic computing is an emerging computing paradigm that moves away from batched processing towards the online, event-driven, processing of streaming data. Neuromorphic chips, when coupled with spike-based sensors, can inherently adapt to the "semantics" of the data distribution by consuming energy only when relevant events are recorded in the timing of spikes and by proving a low-latency response to changing conditions in the environment. This paper proposes an end-toend design for a neuromorphic wireless Internet-of-Things system that integrates spike-based sensing, processing, and communication. In the proposed NeuroComm system, each sensing device is equipped with a neuromorphic sensor, a spiking neural network (SNN), and an impulse radio (IR) transmitter with multiple antennas. Transmission takes place over a shared fading channel to a receiver equipped with a multi-antenna impulse radio receiver and with an SNN. In order to enable adaptation of the receiver to the fading channel conditions, we introduce a hypernetwork to control the weights of the decoding SNN using pilots. Pilots, encoding SNNs, decoding SNN, and hypernetwork are jointly trained across multiple channel realizations. The proposed system is shown to significantly improve over conventional frame-based digital solutions, as well as over alternative non-adaptive training methods, in terms of time-to-accuracy and energy consumption metrics. The work of Osvaldo Simeone and Nicolas Skatchkovsky was supported by the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme, grant agreement No. 725731, by an Open Fellowship of the EPSRC with reference EP/W024101/1, and by the European Union through project CENTRIC (101096379), and the work by Jiechen Chen was funded by the China Scholarship Council and King's College London for their Joint Full-Scholarship (K-CSC) under Grant CSC202108440223.