Function Approximation with the Sweeping Hinge Algorithm
Hush, Don R., Lozano, Fernando, Horne, Bill G.
–Neural Information Processing Systems
We present a computationally efficient algorithm for function approximation with piecewise linear sigmoidal nodes. A one hidden layer network is constructed one node at a time using the method of fitting the residual. The task of fitting individual nodes is accomplished using a new algorithm that searchs for the best fit by solving a sequence of Quadratic Programming problems. This approach offers significant advantages over derivative-based search algorithms (e.g.
Neural Information Processing Systems
Dec-31-1998