A proportional iterative learning control (P-ILC) for linear models of an existing hybrid stroke rehabilitation scheme is implemented for elbow extension/flexion during a rehabilitative task. Owing to transient error growth problem of P-ILC, a learning derivative constraint controller was included to ensure that the controlled system does not exceed a predefined velocity limit at every trial. To achieve this, linear transfer function models of the robot end-effector interaction with a stroke subject (plant) and muscle response to stimulation controllers were developed. A straight-line point-point trajectory of 0 - 0.3 m range served as the reference task space trajectory for the plant, feedforward, and feedback stimulation controllers. At each trial, a SAT-based bounded error derivative ILC algorithm served as the learning constraint controller. Three control configurations were developed and simulated. The system performance was evaluated using the root means square error (RMSE) and normalized RMSE. At different ILC gains over 16 iterations, a displacement error of 0.0060 m was obtained when control configurations were combined.

Functional Electrical Stimulation (FES) is an established and safe technique for contracting muscles by stimulating the skin above a muscle to induce its contraction. However, an open challenge remains on how to restore motor abilities to human limbs through FES, as the problem of controlling the stimulation is unclear. We are taking a robotics perspective on this problem, by developing robot learning algorithms that control the ultimate humanoid robot, the human body, through electrical muscle stimulation. Human muscles are not trivial to control as actuators due to their force production being non-stationary as a result of fatigue and other internal state changes, in contrast to robot actuators which are wellunderstood and stationary over broad operation ranges. We present our Deep Reinforcement Learning approach to the control of human muscles with FES, using a recurrent neural network for dynamic state representation, to overcome the unobserved elements of the behaviour of human muscles under external stimulation. We demonstrate our technique both in neuromuscular simulations but also experimentally on a human. Our results show that our controller can learn to manipulate human muscles, applying appropriate levels of stimulation to achieve the given tasks while compensating for advancing muscle fatigue which arises throughout the tasks. Additionally, Figure 1: Our 3 scenarios for FES control: (a) arm vertical motion our technique can learn quickly enough to be implemented in in simulation (b) and human volunteers, (c) arm horizontal motion real-world human-in-the-loop settings.

Clinical tests have shown that the dynamics of a human arm, controlled using Functional Electrical Stimulation (FES), can vary significantly between and during trials. In this paper, we study the application of the actor-critic architecture, with neural networks for the both the actor and the critic, as a controller that can adapt to these changing dynamics of a human arm. Development and tests were done in simulation using a planar arm model and Hill-based muscle dynamics. We begin by training it using a Proportional Derivative (PD) controller as a supervisor. We then make clinically relevant changes to the dynamics of the arm and test the actor-critic's ability to adapt without supervision in a reasonable number of episodes. Finally, we devise methods for achieving both rapid learning and long-term stability.