vcnn
Retrospective Uncertainties for Deep Models using Vine Copulas
Tagasovska, Nataša, Ozdemir, Firat, Brando, Axel
Despite the major progress of deep models as learning machines, uncertainty estimation remains a major challenge. Existing solutions rely on modified loss functions or architectural changes. We propose to compensate for the lack of built-in uncertainty estimates by supplementing any network, retrospectively, with a subsequent vine copula model, in an overall compound we call Vine-Copula Neural Network (VCNN). Through synthetic and real-data experiments, Figure 1: VCNN: We propose a plug-in vine-copula module we show that VCNNs could be task (regression/classification) that can complement any neural network with uncertainty and architecture (recurrent, estimates, any time after a model has been trained, without fully connected) agnostic while providing reliable requiring any modifications to it. Additionally, our intervals and better-calibrated uncertainty estimates, capture both - aleatoric and epistemic uncertainty.
Frame invariance and scalability of neural operators for partial differential equations
Zafar, Muhammad I., Han, Jiequn, Zhou, Xu-Hui, Xiao, Heng
Partial differential equations (PDEs) play a dominant role in the mathematical modeling of many complex dynamical processes. Solving these PDEs often requires prohibitively high computational costs, especially when multiple evaluations must be made for different parameters or conditions. After training, neural operators can provide PDEs solutions significantly faster than traditional PDE solvers. In this work, invariance properties and computational complexity of two neural operators are examined for transport PDE of a scalar quantity. Neural operator based on graph kernel network (GKN) operates on graph-structured data to incorporate nonlocal dependencies. Here we propose a modified formulation of GKN to achieve frame invariance. Vector cloud neural network (VCNN) is an alternate neural operator with embedded frame invariance which operates on point cloud data. GKN-based neural operator demonstrates slightly better predictive performance compared to VCNN. However, GKN requires an excessively high computational cost that increases quadratically with the increasing number of discretized objects as compared to a linear increase for VCNN.