Signatures of Infinity: Nonergodicity and Resource Scaling in Prediction, Complexity, and Learning