Supplementary Material for AutoMS Automatic Model Selection for Novelty