An in-depth look at approximation via deep and narrow neural networks