consistent weighted sampling
- Europe > Spain > Catalonia > Barcelona Province > Barcelona (0.04)
- Oceania > Australia > New South Wales > Sydney (0.04)
- North America > United States > New Jersey > Middlesex County > Piscataway (0.04)
- (12 more...)
Reviews: Re-randomized Densification for One Permutation Hashing and Bin-wise Consistent Weighted Sampling
The authors propose that the optimal densification for OPH can actually be further optimized. In usual OPH, we get one permutation of the sparse vector, break the vector into K equal sized bins. In the usual Consistent Weighted Sampling (CWS) approach, we sample non-empty bins from these K bins and retrieve a fixed hash code for these bins. In this new approach, the authors suggest to treat each of the K bins as a separate sparse vector and perform MinHash on these retrieved bins to get a hash code instead of directly getting a Hash code. The authors theoretically prove that this re-randomization achieves the smallest variance among densification schemes(that are used to retrieve hash codes from empty buckets). Also, they extend this idea to weighted non-negative sparse vectors (by a method called Bin-wise CWS) The paper seems to be a subtle improvement over prior work.
Engineering a Simplified 0-Bit Consistent Weighted Sampling
Raff, Edward, Sylvester, Jared, Nicholas, Charles
The Min-Hashing approach to sketching has become an important tool in data analysis, search, and classification. To apply it to real-valued datasets, the ICWS algorithm has become a seminal approach that is widely used, and provides state-of-the-art performance for this problem space. However, ICWS suffers a computational burden as the sketch size K increases. We develop a new Simplified approach to the ICWS algorithm, that enables us to obtain over 20x speedups compared to the standard algorithm. The veracity of our approach is demonstrated empirically on multiple datasets, showing that our new Simplified CWS obtains the same quality of results while being an order of magnitude faster.
- North America > United States > New York > New York County > New York City (0.14)
- Asia > China > Hong Kong (0.04)
- North America > United States > District of Columbia > Washington (0.04)
- (5 more...)