Deep Learning: Which Loss and Activation Functions should I use?

The purpose of this post is to provide guidance on which combination of final-layer activation function and loss function should be used in a neural network depending on the business goal. This post assumes that the reader has knowledge of activation functions. Like all machine learning problems, the business goal determines how you should evaluate it's success. If so, you next need to think about how many classes there are and how many labels you wish to find. If your data is binary, it is or isn't a class (e.g.