Can you code a Neural Network using only high school Mathematics?

Recently I was explaining the concept of the neural network to my mother; I couldn’t go beyond the usual trope of inputs, hidden layers, outputs etc. I don’t think I did a very good job at that and…