Theoretical Investigation of Composite Neural Network

A composite neural network is a rooted directed acyclic graph combining a set of pre-trained and non-instantiated neural network models. A pre-trained neural network model is well-crafted for a specific task and with instantiated weights. is generally well trained, targeted to approximate a specific function. Despite a general belief that a composite neural network may perform better than a single component, the overall performance characteristics are not clear. In this work, we prove that there exist parameters such that a composite neural network performs better than any of its pre-trained components with a high probability bound.