Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMs