Scaling of run "time" with dimension
Average running time (aRT in number of f−evaluations as log10 value), divided by dimension for target function value 10^{−8} versus dimension. Slanted grid lines indicate quadratic scaling with the dimension. Different symbols correspond to different algorithms given in the legend of f1 and f24. Light symbols give the maximum number of function evaluations from the longest trial divided by dimension. Black stars indicate a statistically better result compared to all other algorithms with p < 0.01 and Bonferroni correction number of dimensions (six). Legend: ○: ALPS hornby noisy, ♢: AMALGAM bosman noisy, ☆: BAYEDA gallagher noisy, ▼: BFGS ros noisy, ⬡: BIPOP-CMA-ES hansen noisy, △: CMA-ESPLUSSEL auger noisy, ⬠: DASA korosec noisy, rightY: DE-PSO garcia-nieto noisy, downY: EDA-PSO el-abd noisy, ◇: FULLNEWUOA ros noisy, ◁: GLOBAL pal noisy, ▼: IPOP-SEP-CMA-ES ros noisy, ☆: MA-LS-CHAIN molina noisy, ◻: MCS huyer noisy, ♢: ONEFIFTH auger noisy, △: PSO Bounds el-abd noisy, ◁: PSO el-abd noisy, ⬡: RANDOMSEARCH auger noisy, ⬠: SNOBFIT huyer noisy, ⬣: VNS garcia-martinez noisy, downY: iAMALGAM bosman noisy