Efficient Autoregressive Inference for Transformer Probabilistic Models