Snapshot Ensemble with SGDR

At the end of my previous post on Which Continent Does PyoungChang Belong To? I made a simple-voting-based ensemble function. Given city name, the ensemble model loads five models and aggregates their inference results, and chooses the most voted continent as its final prediction. This ensemble model's f1-score was 0.571 which was 0.005 higher than the single model's 0.566. Taking advantage of the collaborative power is simple to build and easy to use, but it forced me to set up and train multiple models.