HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks