INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization Formats