Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational cost, in terms of training procedures. Our approach is mathematically interpretable and backed by rigorous theoretical guarantees in the form of quantitative worst-case error bounds for the learned equation. Numerical benchmarks demonstrate significant improvements in computational complexity and robustness while achieving one to two orders of magnitude improvements in terms of accuracy compared to state-of-the-art algorithms. Significance statement We present a novel algorithm inspired by kernel methods and Gaussian processes for learning differential equations and their solution operators in scarce data regimes. Our approach: (a) is significantly more efficient than state-of-the-art methods, including neural networks, in terms of required data and computational time. In fact, we obtain one to two orders of magnitude improvement in accuracy on a number of benchmarks; (b) is supported by rigorous theory featuring the first quantitative worst-case error bounds for equation learning; and (c) can solve previously intractable scientific computing problems such as one-shot operator learning and learning of variable-coefficient PDEs in extremely scarce data regimes.