[P] Alternatives to Softmax for prediction • r/MachineLearning

You can actually use just tanh, sigmoid, or even no activation function at all. The main difference is that softmax gives you „probabilities" which sum to 1. while tanh/sigmoid give you activations between 0-1 / -1-1 and leaving out the activation doesn't put any bounds on it at all. it totally depends on the task you are working on.