POCO: Scalable Neural Forecasting through Population Conditioning