Binary Classification on MatConvNet • /r/MachineLearning

You will often find good/best performance using a softmax loss with 2 components, but you can also use a single binary output. Also don't be afraid to use the source code as an example and implement your own loss if you need something else - it's actually quite readable.