[P] Implementing a CapsNet for car make-model classification • r/MachineLearning

I'm playing with CapsNet using Tensorflow to classify images taken from a traffic cam. I decided to start with just two classes (Fiat-Panda and Fiat-500) and I created a dataset with cropped images of car's rear. I reached a 0.56 accuracy on the testset which is pretty low for a 2-class classification problem. Here you can see the recap. The decoder on the final caps layer outputs mixed images of the two classes and the loss function on the test set doesn't converge.