[D] Regression output range, [-1, 1]or[0, 1] vs [-inf, inf] • r/MachineLearning

Currently I'm trying to solve regression problem with deep neural network. I have some problems and I couldn't find appropriate answers from google so I'm here to ask your ideas. My data samples are in [0, 1]N. Because of this range, I had to use sigmoid(or tanh) as activation of output layer(Other layer's activations are all ReLU). However this cause serious problem which is gradient vanishing.