Neural network integral representations with the ReLU activation function
Dereventsov, Anton, Petrosyan, Armenak, Webster, Clayton
We derive a formula for neural network integral representations on the sphere with the ReLU activation function under the finite $L_1$ norm (with respect to Lebesgue measure on the sphere) assumption on the outer weights. In one dimensional case, we further solve via a closed-form formula all possible such representations. Additionally, in this case our formula allows one to explicitly solve the least $L_1$ norm neural network representation for a given function.
Oct-7-2019
- Country:
- North America > United States > Tennessee
- Knox County > Knoxville (0.04)
- Anderson County > Oak Ridge (0.04)
- North America > United States > Tennessee
- Genre:
- Research Report (0.50)
- Industry:
- Technology: