Scaling of run "time" with number of constraints
![](ppfigcons_Sphere_d2.svg)
![](ppfigcons_Sphere_d3.svg)
![](ppfigcons_Sphere_d5.svg)
![](ppfigcons_Sphere_d10.svg)
![](ppfigcons_Sphere_d20.svg)
![](ppfigcons_Sphere_d40.svg)
![](ppfigcons_Separable Ellipsoid_d2.svg)
![](ppfigcons_Separable Ellipsoid_d3.svg)
![](ppfigcons_Separable Ellipsoid_d5.svg)
![](ppfigcons_Separable Ellipsoid_d10.svg)
![](ppfigcons_Separable Ellipsoid_d20.svg)
![](ppfigcons_Separable Ellipsoid_d40.svg)
![](ppfigcons_Linear Slope_d2.svg)
![](ppfigcons_Linear Slope_d3.svg)
![](ppfigcons_Linear Slope_d5.svg)
![](ppfigcons_Linear Slope_d10.svg)
![](ppfigcons_Linear Slope_d20.svg)
![](ppfigcons_Linear Slope_d40.svg)
![](ppfigcons_Rotated Ellipsoid_d2.svg)
![](ppfigcons_Rotated Ellipsoid_d3.svg)
![](ppfigcons_Rotated Ellipsoid_d5.svg)
![](ppfigcons_Rotated Ellipsoid_d10.svg)
![](ppfigcons_Rotated Ellipsoid_d20.svg)
![](ppfigcons_Rotated Ellipsoid_d40.svg)
![](ppfigcons_Discus_d2.svg)
![](ppfigcons_Discus_d3.svg)
![](ppfigcons_Discus_d5.svg)
![](ppfigcons_Discus_d10.svg)
![](ppfigcons_Discus_d20.svg)
![](ppfigcons_Discus_d40.svg)
![](ppfigcons_Bent Cigar_d2.svg)
![](ppfigcons_Bent Cigar_d3.svg)
![](ppfigcons_Bent Cigar_d5.svg)
![](ppfigcons_Bent Cigar_d10.svg)
![](ppfigcons_Bent Cigar_d20.svg)
![](ppfigcons_Bent Cigar_d40.svg)
![](ppfigcons_Different Powers_d2.svg)
![](ppfigcons_Different Powers_d3.svg)
![](ppfigcons_Different Powers_d5.svg)
![](ppfigcons_Different Powers_d10.svg)
![](ppfigcons_Different Powers_d20.svg)
![](ppfigcons_Different Powers_d40.svg)
![](ppfigcons_Separable Rastrigin_d2.svg)
![](ppfigcons_Separable Rastrigin_d3.svg)
![](ppfigcons_Separable Rastrigin_d5.svg)
![](ppfigcons_Separable Rastrigin_d10.svg)
![](ppfigcons_Separable Rastrigin_d20.svg)
![](ppfigcons_Separable Rastrigin_d40.svg)
![](ppfigcons_Rotated Rastrigin_d2.svg)
![](ppfigcons_Rotated Rastrigin_d3.svg)
![](ppfigcons_Rotated Rastrigin_d5.svg)
![](ppfigcons_Rotated Rastrigin_d10.svg)
![](ppfigcons_Rotated Rastrigin_d20.svg)
Expected running time (ERT in number of evaluations as log10 value), divided by dimension for target function value 10^{−6} versus number of constraints. Slanted grid lines indicate quadratic scaling with the dimension. Different symbols correspond to different algorithms given in the legend of f1 − f54. If the success ratio is < 1/2 and > 0 the symbol is annotated with the number of successes. Light symbols give the maximum number of evaluations from the longest trial divided by dimension. Black stars (if present) indicate a statistically better result compared to all other algorithms with p < 0.01 and Bonferroni correction number of constraints (six). Legend: ○: AL1-CMA-ES Dufosse, ♢: AL2-CMA-ES Dufosse, ☆: AL3-CMA-ES Dufosse, +: AL4-CMA-ES Dufosse, ⬠: BPepsMAg Hellwig, ▼: COBYLA Dufosse, x: RandomSearch-5 Dufosse, △: epsMAg Hellwig, ◇: fmincon Hellwig