Scalable Global Optimization via Local Bayesian Optimization

David Eriksson, Michael Pearce, Jacob Gardner, Ryan D. Turner, Matthias Poloczek

Neural Information Processing Systems 

Bayesian optimization has recently emerged as a popular method for the sampleefficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains challenging, and on difficult problems Bayesian optimization is often not competitive with other paradigms. In this paper we take the view that this is due to the implicit homogeneity of the global probabilistic models and an overemphasized exploration that results from global acquisition.