Alert button

Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces

Add code
Bookmark button
Alert button
Apr 22, 2023
Leonard Papenmeier, Luigi Nardi, Matthias Poloczek

Figure 1 for Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces
Figure 2 for Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces
Figure 3 for Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces
Figure 4 for Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture search, and robotics. However, a closer examination reveals that the state-of-the-art methods for high-dimensional Bayesian optimization (HDBO) suffer from degrading performance as the number of dimensions increases or even risk failure if certain unverifiable assumptions are not met. This paper proposes BAxUS that leverages a novel family of nested random subspaces to adapt the space it optimizes over to the problem. This ensures high performance while removing the risk of failure, which we assert via theoretical guarantees. A comprehensive evaluation demonstrates that BAxUS achieves better results than the state-of-the-art methods for a broad set of applications.

* Advances in Neural Information Processing Systems 35 (NeurIPS 2022)  * 28 pages, 8 figures. Accepted to NeurIPS 2022. This is the revised version and includes the appendix  
View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon