Algorithmic Robust Forecast Aggregation

Guo, Yongkang, Hartline, Jason D., Huang, Zhihuan, Kong, Yuqing, Shah, Anant, Yu, Fang-Yi

arXiv.org Artificial Intelligence 

Forecast aggregation combines the predictions of multiple agents into a more accurate prediction. With forecast aggregation, decision-makers can reduce error, diversify risk and enhance accuracy based on the collective knowledge of agents compared to any single agent, thereby advancing the common good. Forecast aggregation is commonly used in many domains to generate more informed predictions for various variables, such as weather in weather forecasting, the spread of infectious diseases in public health, the outcome of games in sports, fuel prices in energy, and GDP growth in economics. In practice, one crucial challenge of forecast aggregation is that the aggregator may not have full knowledge of the information structure and the agents. Without this prior knowledge, the aggregator cannot employ Bayes rules to combine the forecasts optimally. Traditional prior-free aggregation methods, such as simple averaging, are especially bad on some information structures. For example, in weather forecasting, assume the prior probability of raining tomorrow is 30%, and there are two agents who will receive a conditionally independent binary signal (Low or High). Agents will report their posterior, which is 10% given the Low signal and 50% given the High signal. When both agents report 50%, the simple averaging will also output 50%.