Solving the Poisson Equation with Dirichlet data by shallow ReLU$^\alpha$-networks: A regularity and approximation perspective