Welcome to the BBOB workshop series!

The Black-box Optimization Benchmarking (BBOB) workshop series provides an easy-to-use toolchain for benchmarking black-box optimization algorithms for continuous and mixed-integer domains and a place to present, compare, and discuss the performance of numerical black-box optimization algorithms. The former is realized through the Comparing Continuous Optimizers platform (Coco).

So far, ten workshops have been held (in 2009, 2010, 2012, 2013, 2015, 2016, 2017, 2018, and 2019 at GECCO and in 2015 at CEC).

The next workshop, BBOB 2021, celebrating the workshop series’ 10th edition at GECCO, will take place at GECCO’2021.

Generally, six benchmark suites are available:

  • bbob containing 24 noiseless functions

  • bbob-noisy containing 30 noisy functions

  • bbob-biobj containing 55 noiseless, bi-objective functions, generated from the bbob suite

  • bbob-largescale containing 24 noiseless functions in dimension 20 to 640

  • bbob-mixint containing 24 noiseless mixed-integer functions

  • bbob-biobj-mixint containing 92 noiseless, bi-objective, mixed-integer functions.

Note that due to the rewriting of the Coco platform, the bbob-noisy test suite is not yet available in the new code from http://github.com/numbbo/coco . Please use the old code at http://coco.gforge.inria.fr/doku.php?id=downloads instead for running experiments on bbob-noisy.