Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?