Scaling of run "time" with dimension
Average running time (aRT in number of f−evaluations as log10 value), divided by dimension for target function value 10^{−8} versus dimension. Slanted grid lines indicate quadratic scaling with the dimension. Different symbols correspond to different algorithms given in the legend of f1 and f24. Light symbols give the maximum number of function evaluations from the longest trial divided by dimension. Black stars indicate a statistically better result compared to all other algorithms with p < 0.01 and Bonferroni correction number of dimensions (six). Legend: ○: ALPS hornby noiseless, ♢: AMALGAM bosman noiseless, ☆: BAYEDA gallagher noiseless, ▼: BFGS ros noiseless, ⬡: BIPOP-CMA-ES hansen noiseless, △: CMA-ESPLUSSEL auger noiseless, ⬠: Cauchy-EDA posik noiseless, rightY: DASA korosec noiseless, downY: DE-PSO garcia-nieto noiseless, ◇: DIRECT posik noiseless, ◁: EDA-PSO el-abd noiseless, ▼: FULLNEWUOA ros noiseless, ☆: G3PCX posik noiseless, ◻: GA nicolau noiseless, ♢: GLOBAL pal noiseless, △: IPOP-SEP-CMA-ES ros noiseless, ◁: LSfminbnd posik noiseless, ⬡: LSstep posik noiseless, ⬠: MA-LS-CHAIN molina noiseless, ⬣: MCS huyer noiseless, downY: NELDERDOERR doerr noiseless, upY: NELDER hansen noiseless, leftY: NEWUOA ros noiseless, rightY: ONEFIFTH auger noiseless, ◇: POEMS kubalik noiseless, ♢: PSO Bounds el-abd noiseless, ☆: PSO el-abd noiseless, ▼: RANDOMSEARCH auger noiseless, ⬡: Rosenbrock posik noiseless, △: VNS garcia-martinez noiseless, ⬠: iAMALGAM bosman noiseless