Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep connection with kernel methods. Our contributions are threefold: a) We rigorously establish the recurrent kernel limit of Reservoir Computing and prove its convergence.

Developmental Graph Cellular Automata (DGCA) are a novel model for morphogenesis, capable of growing directed graphs from single-node seeds. In this paper, we show that DGCAs can be trained to grow reservoirs. Reservoirs are grown with two types of targets: task-driven (using the NARMA family of tasks) and task-independent (using reservoir metrics). Results show that DGCAs are able to grow into a variety of specialized, life-like structures capable of effectively solving benchmark tasks, statistically outperforming `typical' reservoirs on the same task. Overall, these lay the foundation for the development of DGCA systems that produce plastic reservoirs and for modeling functional, adaptive morphogenesis.

Department of Mathematical and Computer Sciences, Physical Sciences and Earth Sciences, University of Messina, 8166 Messina, Italy Complex and even chaotic dynamics, though prevalent in many natural and engineered systems, has been largely avoided in the design of electromechanical systems due to concerns about wear and controlability. Here, we demonstrate that complex dynamics might be particularly advantageous in soft robotics, offering new functionalities beyond motion not easily achievable with traditional actuation methods. We designed and realized resilient magnetic soft actuators capable of operating in a tunable dynamic regime for tens of thousands cycles without fatigue. We experimentally demonstrated the application of these actuators for true random number generation and stochastic computing. These findings show that exploring the complex dynamics in soft robotics would extend the application scenarios in soft computing, human-robot interaction and collaborative robots as we demonstrate with biomimetic blinking and randomized voice modulation. A large number of mechanical systems, including simple ones such as the double pendulum, exhibit dynamics characterized by deterministic periodic and chaotic responses depending on the excitation frequency f and amplitude A of the applied force [1]. Mechanical systems with a tendency to chaotisation demonstrate multiple resonances and various transitions to chaos [2]. Today, the concept of complexity and, especially, deterministic chaos that refers to systems without stochastic fluctuations jet losing stability of phase space trajectories is explored for a variety of directions [3] even including biological systems [4] or optics [5]. In particular, chaos is a fundamental aspect of electromechanical systems and is broadly explored in motion planning for mobile rigid robots, fluid mixing, and improving energy harvesting, as well as in mechanisms used in washing machines, dishwashers, and air conditioners [6]. Although the analysis of traditional robotics and mechanisms has revealed inherent chaotic dynamics [7], chaos can also be intentionally generated through nonlinear feedback [6] to achieve specific functionalities. In contrast to rigid mechanisms, soft actuators can facilitate transition into complex dynamics without the need for dedicated feedback algorithms. Mechanically soft actuators do not possess any rigid components in their embodiment rendering them ideally suited to explore complex and even chaotic dynamics which is typically observed at higher frequencies (Supplementary Tables 1 and 2). The inherent nonlinear oscillations emerging in soft actuators for specific parameter values [8, 9] can be applied for secure, biomimetic, and soft computing applications.

In this study, we design a reservoir computing (RC) network by exploiting short- and long-term memory dynamics in Au/Ti/MoS$_2$/Au memristive devices. The temporal dynamics is engineered by controlling the thickness of the Chemical Vapor Deposited (CVD) MoS$_2$ films. Devices with a monolayer (1L)-MoS$_2$ film exhibit volatile (short-term memory) switching dynamics. We also report non-volatile resistance switching with excellent uniformity and analog behavior in conductance tuning for the multilayer (ML) MoS$_2$ memristive devices. We correlate this performance with trap-assisted space-charge limited conduction (SCLC) mechanism, leading to a bulk-limited resistance switching behavior. Four-bit reservoir states are generated using volatile memristors. The readout layer is implemented with an array of nonvolatile synapses. This small RC network achieves 89.56\% precision in a spoken-digit recognition task and is also used to analyze a nonlinear time series equation.

A list of different activation functions and their associated kernels is provided in Table 3. ( t 1) Analytic formulas in more general cases may not exist and they would need to be replaced by successive integrals. The successive integrals can still be explicitly defined. Eq. (28) describes the asymptotic kernel limit for any This independence hypothesis is required in Eq. (18) and Eq. However, this assumption is unrealistic for practical Reservoir Computing. This is valid for several activation functions, the ones presented in Table 3.

Understanding Neural networks in general, and how to train Recurrent Neural Networks (RNNs) in particular, remains a central question in modern machine learning.

However, we will add a conclusion to discuss future lines of work in the next version.

A Novel Reservoir Computing Framework for Chaotic Time Series Prediction Using Time Delay Embedding and Random Fourier Features S. K. Laha Advanced Design and Analysis Group CSIR - Central Mechanical Engineering Research Institute MG Avenue, Durgapur, West Bengal, PIN - 713209, India Abstract: Forecasting chaotic time series requires models that can capture the intrinsic geometry of the underlying attractor while remaining computationally efficient. We introduce a novel reservoir computing (RC) framework that integrates time - delay embedding with Random Fourier Feature (RFF) mappings to construct a dynamical reservoir without the need for traditional recurrent architectures. Unlike standard RC, which relies on high - dimensional recurrent connectivity, the proposed RFF - RC explicitly approximates non linear kernel transformations that uncover latent dynamical relations in the reconstructed phase space. This hybrid formulation offers two key advantages: (i) it provides a principled way to approximate complex nonlinear interactions among delayed coordina tes, thereby enriching the effective dynamical representation of the reservoir, and (ii) it reduces reliance on manual reservoir hyperparameters such as spectral radius and leaking rate. We evaluate the framework on canonical chaotic systems - the Mackey - Gla ss equation, the Lorenz system, and the Kuramoto - Sivashinsky equation. This novel formulation demonstrates that RFF - RC not only achieves superior prediction accuracy but also yields robust attractor reconstructions and long - horizon forecasts.

Machine learning techniques offer an effective approach to modeling dynamical systems solely from observed data. However, without explicit structural priors -- built-in assumptions about the underlying dynamics -- these techniques typically struggle to generalize to aspects of the dynamics that are poorly represented in the training data. Here, we demonstrate that reservoir computing -- a simple, efficient, and versatile machine learning framework often used for data-driven modeling of dynamical systems -- can generalize to unexplored regions of state space without explicit structural priors. First, we describe a multiple-trajectory training scheme for reservoir computers that supports training across a collection of disjoint time series, enabling effective use of available training data. Then, applying this training scheme to multistable dynamical systems, we show that RCs trained on trajectories from a single basin of attraction can achieve out-of-domain generalization by capturing system behavior in entirely unobserved basins.