Energy Efficient Hardware for On-Device CNN Inference via Transfer Learning