Statistical Learning
One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objective
A deep hashing model typically has two main learning objectives: to make the learned binary hash codes discriminative and to minimize a quantization error. With further constraints such as bit balance and code orthogonality, it is not uncommon for existing models to employ a large number (>4) of losses.
SupplementaryMaterial: ExtrapolationTowardsImaginary0-NearestNeighbour andItsImprovedConvergenceRate ARelatedworks
In this section, we describe Nadaraya-Watson (NW) classifier, Local Polynomial (LP) classifier and their convergence rates (Audibert & Tsybakov, 2007). In what follows,K: X R represents a kernel function, e.g., Gaussian kernel K(X):=exp( kXk22),andh>0representsabandwidth. LP classifier is thus proved to be an optimal classifier in this sense. The two error terms are in fact combined asฮดฮฒ,r(X) = O(rฮฒ), because 2bฮฒ/2c+2 ฮฒ. In step (i), queries are first classified into two different cases, i.e., (X) io and (X) > io.