Constructing a variational family for nonlinear state-space models

Mathematical models of system dynamics are a core technology in most model-based engineered systems acting and interacting with their environment. Examples include GPS, autonomous vehicles, passenger aircraft and robotics, to name just a few. The remarkable utility of mathematical models stems from the fact that, inter alia, they enable decision making based on prediction of system behaviour under new scenarios, accelerate the analysis and design processes, are fundamental to detecting faults or changes, and they are capable of handling uncertainty that is present in data, assumptions and algorithms. Motivated by the broad applicability and utility of modelling, the scientific community has devoted significant research attention towards learning dynamical models from data. Importantly, for dynamic systems, the sequence or ordering of the data must be maintained as future outcomes are deemed to be fundamentally related to the past. This is sometimes called sequence learning (Sun and Giles, 2001) or system identification (Ljung, 1999). In essence, these approaches search over a space of models and determine the model that best (in some sense) fits the data while maintaining the time ordering. The current paper is directed towards solving this important problem. To make these ideas more concrete, here we assume that data from the system of interest is available in the form of a data record y 1:T {y 1,...,y T }, where each measurementy k is potentially multidimensional and the number of available measurements is denoted as T 0. We further assume that the data may be adequately described as an instance from a joint distribution that is parametrized by an unknown vectorθ (called the parameter vector), that is (with abuse of notation)