Country
16009ce3d8a6872d79f056c75618911d-Paper-Conference.pdf
Many important datasets contain samples that are missing one or more feature values. Maintaining the interpretability of machine learning models in the presence of such missing data is challenging. Singly or multiply imputing missing values complicates the model's mapping from features to labels. On the other hand, reasoning on indicator variables that represent missingness introduces a potentially largenumber ofadditional terms, sacrificing sparsity.
Transformation
Particularly important is the ability to incorporate domain knowledge of invariances, e.g., translational invariance ofimages. Kernels based onthemaximumsimilarity overagroup of transformations are not generally positive definite. Perhaps it is for this reason that they have not been studied theoretically. We address this lacuna and show thatpositivedefiniteness indeed holdswith high probabilityforkernels based on the maximum similarity in the small training sample set regime of interest, and that they do yield the best results in that regime.
Transformation
Particularly important is the ability to incorporate domain knowledge of invariances, e.g., translational invariance ofimages. Kernels based onthemaximumsimilarity overagroup of transformations are not generally positive definite. Perhaps it is for this reason that they have not been studied theoretically. We address this lacuna and show thatpositivedefiniteness indeed holdswith high probabilityforkernels based on the maximum similarity in the small training sample set regime of interest, and that they do yield the best results in that regime.